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The  reliability  and  validity  of  the  Dyadic  Parent-Child 
Interaction  Coding  System — II  (DPICS  II)  was  assessed  in  the 
present  study.   The  DPICS  II  is  the  revised  version  of  a 
behavioral  observation  coding  system  used  in  research  and 
clinical  settings  to  describe  the  quality  of  parent-child 
dyadic  interactions.   The  DPICS  II  contains  25  categories  to 
code  parents'  and  children's  verbal  and  nonverbal  behavior 
including  commands,  compliance  to  commands,  questions, 
praise,  yell,  whine,  destructive,  and  criticism. 

The  study  participants  were  sixty  mother-child  dyads 
representing  a  clinic-referred  group  (n  =  30)  and  a  non- 
problem  comparison  group  (n  =  30).   The  children  in  the 
clinic-referred  group  were  participants  in  a  large  treatment 
outcome  study  (N  ■  100)  for  preschool  children  with  behavior 
problems.   All  participants  had  met  diagnostic  criteria  for 


Oppositional  Defiant  Disorder.   The  data  on  the  clinic- 
referred  families  used  in  the  present  study  was  collected  as 
part  of  the  families'  standard  initial  assessment  in  the 
larger  outcome  study.   The  mother-child  pairs  in  the 
comparison  group  were  recruited  from  the  Gainesville,  FL 
community  through  advertisements.   To  be  included  in  the 
study,  the  children  in  the  comparison  group  received 
maternal  ratings  on  the  Eyberg  Child  Behavior  Inventory 
(ECBI) — Problem  Scale  of  11  or  less. 

The  two  groups  were  compared  on  several  measures 
including  the  Parenting  Stress  Index  (PSI),  the  Parenting 
Locus  of  Control  (PLOC),  and  the  ECBI  as  well  as  DPICS  II 
behavioral  observations.   Videotapes  of  the  parent-child 
dyads  were  coded  by  observers  trained  to  use  the  DPICS  II. 
The  primary  coders  were  blind  to  the  group  membership  and  to 
the  study  hypotheses.   Fifty  percent  of  the  videotapes, 
randomly  selected,  were  re-coded  to  evaluate  reliability. 
Reliability  was  assessed  using  percent  agreement,  intraclass 
correlations,  and  Cohen's  kappa.   Overall,  the  DPICS  II 
categories  were  shown  to  have  acceptable  reliability 
estimates.   The  DPICS  II  also  demonstrated  convergent 
validity  by  accounting  for  a  significant  proportion  of 
variance  in  the  scores  on  the  ECBI,  the  PLOC,  and  the  parent 
and  child  scales  of  the  PSI.   Selected  DPICS  II  categories 
were  used  in  a  discriminant  analysis  and  correctly 


classified  families  into  the  clinic-referred  and  non- 
referred  groups. 


INTRODUCTION 
Direct  behavioral  observation  measures  have  been  called 
the  "hallmark"  of  behavioral  assessment  (Ciminero,  1986)  and 
have  been  used  widely  across  content  areas  within  the  field 
of  psychology  (Foster  &  Cone,  1986;  Bornstein,  Bridgwater, 
Hickey,  &  Sweeney,  1980).    Systems  for  observing  behavior 
have  proven  to  be  particularly  valuable  tools  for  the 
assessment  of  behavior  problems  in  children  (McMahon  & 
Forehand,  1988).   Observational  methods  are  useful  with 
children  because  they  have  difficulty  providing  an  accurate 
self-report,  particularly  about  socially  undesirable  or 
inappropriate  behavior  (Hartmann  &  Wood,  1990).   In 
addition,  there  are  concerns  about  the  accuracy  of  parental 
perceptions  of  children's  disruptive  behavior  (Wahler  8 
Sansbury,  1992).    Direct  observation  by  an  independent 
observer  of  children's  behavior  and  their  interactions  with 
relevant  individuals  in  their  environments  is  considered  to 
provide  the  most  objective  description  of  target  behaviors, 
such  as  noncompliance  to  parental  commands  and  the 
effectiveness  of  the  parents'  responses  (McMahon  &  Forehand, 
1988). 

Although  there  is  considerable  support  for  using  direct 
observation  as  an  assessment  device,  concerns  regarding  the 
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practicality  of  direct  observation,  particularly  in  clinical 
settings,  have  been  raised  (Mash  &  Terdal,  1988).   Direct 
observation  in  naturalistic  settings,  such  as  the  home  or 
school,  is  thought  to  be  too  time-consuming  for  typical 
clinical  applications,  while  observation  of  free  play  in 
analogue  situations  is  thought  to  yield  information  about 
behavior  that  may  not  be  generalizable  to  more  relevant 
settings.   Structured  behavioral  observations  in  the 
laboratory  setting  have  been  proposed  as  an  effective 
alternative  because  they  can  efficiently  elicit  the  target 
behaviors  and  can  facilitate  comparison  of  behavior  across 
subjects  (Hughes  &  Haynes,  1978). 

The  literature  concerning  direct  observation  systems 
contains  guidelines  for  the  development  and  use  of  these 
systems  with  children.   Roberts  and  Forehand  (1978)  stated 
that  for  an  observational  system  to  be  most  useful  it  should 
accomplish  several  goals:  1)  describe  maladaptive  parent- 
child  interactions,  2)  define  the  child  behavior(s)  targeted 
for  change,  3)  specify  the  appropriate  treatment 
intervention,  4)  evaluate  the  effects  of  the  intervention. 
To  this,  one  should  add  specifying  the  parent  behaviors 
targeted  for  change.   In  addition,  Goldfried  (1979) 
advocated  that  observation  systems  should  meet  accepted 
standards  of  reliability  and  validity.   He  also  criticized 
many  behavioral  observation  systems  for  children  for  lacking 
normative  data. 
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The  recent  literature  on  behavioral  observations 
reflects  an  awareness  of  the  complex  methodological  issues 
involved  in  utilizing  observation  systems.   While  behavioral 
observations  were  once  seen  as  inherently  objective  and 
valid,  factors  such  as  frequency  of  occurrence  (Hartmann, 
1977),  complexity  of  the  coding  system  (Hops,  Davis,  & 
Longoria,  1995;  Jones,  Reid,  8  Patterson,  1974; 
Mash  &  McElwee,  1974;  Kazdin,  1977),  and  observer 
expectancies  (Kazdin,  1977)  all  have  an  impact  on  the 
reliability  and  validity  of  the  observational  data.  Current 
guidelines  for  utilizing  behavioral  observation  coding 
systems  incorporate  and  attempt  to  account  for  these 
influences . 

Methods  for  estimating  the  reliability  of  direct 
observational  data  have  also  been  developed  and  improved. 
Percent  agreement,  as  a  indicator  of  interobserver 
agreement,  has  been  the  most  widely  used  estimate  of 
reliability  due  to  its  ease  of  computation  and  its  ability 
to  provide  immediate  assessment  of  agreement  for  an 
individual  session  (Jacob,  Tennebaum  &  Krahn,  1987). 
Percent  agreement  also  has  been  the  most  widely  criticized 
form  of  reliability  (Suen  &  Ary,  1989).   Researchers  have 
frequently  cited  the  potential  for  percent  agreement  figures 
to  be  inflated  by  chance  agreement,  particularly  for 
behaviors  with  a  high  base  rate  (Jacob,  Tennebaum,  &  Krahn, 
1987).   Computing  percent  agreement  on  occurrences  only  for 
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low  base  rate  behavior  and  on  nonoccurrences  of  high  base 
rate  behaviors  has  been  suggested  as  one  way  to  limit  the 
chance  of  artificial  inflation  of  the  reliability  estimates 
(Suen  8  Ary,  1989) . 

Acceptable  values  for  percent  agreement  have  also  been 
disputed.   Eighty  percent  agreement  has  been  offered  as  a 
reasonable  standard  for  reliability  estimates  (Page  &  Iwata, 
1986).   However,   Jones,  Reid,  and  Patterson  (1974)  support 
using  70%  agreement  as  the  minimal  accepted  standard  for 
more  complex  coding  systems. 

In  spite  of  attempts  to  establish  a  standard  for 
percent  agreement  estimates,  acceptable  reliability  has  been 
shown  to  be  dependent  on  such  factors  as  the  occurrence  of 
the  behavior  (Suen  &  Ary,  1989)  and  the  complexity  of  the 
coding  system  (Jones,  Reid,  S  Patterson,  1974).   For 
example,  75%  agreement  for  a  behavior  with  a  base  rate  of 
occurrence  of  45%  of  the  observation  period  is  better  than 
75%  agreement  for  a  behavior  occurring  70%  of  the  time. 
Awareness  of  the  base  rate  is  important,  therefore,  in 
evaluating  a  given  reliability  estimate  using  percent 
agreement.   Studies  examining  the  relationship  between 
complexity  of  the  coding  system,  (i.e.,  the  number  of 
discriminations  reguired  of  the  observer  during  an 
observation  period)  and  estimates  of  interobserver  agreement 
have  found  significant  correlations,  with  values  ranging 
from  -.52  to  -.75  (Jones,  Reid,  &  Patterson,  1974). 
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Similarly,  Mash  and  McElwee  (1974)  found  that  percent 
agreement  was  reduced  by  increasing  the  number  of  categories 
in  a  system  from  four  to  eight.   The  aforementioned 
difficulties  in  using  percent  agreement  as  an  estimate  of 
reliability  have  resulted  in  it  becoming  the  least 
recommended  method  (Hops,  Davis,  &  Longoria,  1995;  Suen  & 
Ary,  1989). 

Although  numerous  types  of  reliability  estimates  exist 
(Suen,  Ary,  &  Ary,  1986),  users  of  observation  systems  are 
more  frequently  advocating  the  use  of  either  the  kappa 
statistic  and/or  intraclass  correlations  (Hops,  Davis,  and 
Longoria,  1995;  Suen  &  Ary,  1989).   Percent  agreement  and 
kappa  both  provide  an  estimate  of  interobserver  agreement 
with  kappa  having  the  added  benefit  of  correcting  for  chance 
agreement.   Kappa  "...is  the  ratio  of  actual  nonchance 
agreements  divided  by  the  total  possible  nonchance 
agreements"  (Suen  8  Ary,  1989,  p. 11 2).   Kappa  estimates  have 
been  widely  recommended  for  use  as  a  measure  of 
interobserver  agreement  (Hops,  Davis,  and  Longoria,  1995; 
Jacob,  Tennebaum,  &  Krahn,  1987).   The  range  of  possible 
kappa  values  extends  from  -1.00  to  1.00.   As  the  values 
approach  zero  and  negative  numbers,  reliability  is 
considered  to  be  at  chance  levels  of  agreement  or  lower. 
Kappa  values  above  .75  are  considered  excellent,  and  values 
from  .60  to  .75  are  considered  good  (Fleiss,  1981). 
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Although  intraclass  correlations  have  been  discussed  in 
the  literature  on  behavioral  observations  and  proposed  as  an 
estimate  of  reliability  for  many  years  (Jones,  Reid,  & 
Patterson,  1974),  it  appears  that  only  recently  intraclass 
correlations  have  become  more  widely  known  and  used  within 
the  field  of  behavioral  assessment.   Based  on  the 
Generalizability  Theory  (Cronbach,  Gleser,  Nanda,  & 
Rajaratnam,  1972),  reliability  is  seen  within  the  context  of 
situational  factors  such  as  observers,  setting,  and  time. 
Analysis  of  variance  procedures  are  used  to  evaluate  these 
factors  to  determine  the  sources  of  variance  in  the 
observation  data.   Sources  of  error  can  then  be  partitioned 
out  leaving  only  the  true  variance  attributed  to  a 
particular  factor  (Suen  &  Ary,  1989;  Hartmann  &  Wood,  1990). 
Intraclass  correlations  are  recommended  over  kappa  and 
percent  agreement  because  they  can  provide  an  estimate  of 
both  intraobserver  and  interobserver  reliability  (Hops, 
Davis,  &  Longoria,  1995;  Suen,  1988).   The  design  of  the 
study,  of  course,  has  implications  for  which  aspects  of 
reliability  (e.g,  setting,  time)  can  be  evaluated  (Suen  & 
Ary,  1989).   Some  of  the  designs  require  significantly  more 
duplicate  coding,  which  can  be  impractical  and  costly, 
compared  to  other  reliability  estimates  (Jacob,  Tennenbaum, 
&  Krahn,  1987).   Overall,  intraclass  correlations  and  the 
generalizability  theory  have  been  described  in  positive 
terms  as  broadening  the  scope  of  analysis  for  reliability 
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studies  to  include  contextual  factors  that  may  or  may  not 
limit  the  generalizability  of  the  data  (Hartmann  8  Wood, 
1990) . 

Characteristics  of  Children  with  Oppositional  Defiant 
Disorder  and  their  Parents 

Children  diagnosed  with  Oppositional  Defiant  Disorder 
demonstrate  a  "recurrent  pattern  of  negativistic,  defiant, 
disobedient,  and  hostile  behavior  toward  authority  figures", 
according  to  the  Diagnostic  and  Statistical  Manual  of  Mental 
Disorders,  4th  Edition  (DSM-IV)  (American  Psychiatric 
Association  [APA],  1994).   According  to  the  DSM-IV, 
Estimates  of  the  prevalence  of  this  disorder  in  children 
range  from  2%  to  16%  (APA,  1994).   Attention- 
Deficit/Hyperactivity  Disorder,  Learning  Disorders,  and 
Communication  Disorders  often  co-occur  in  children  diagnosed 
with  Oppositional  Defiant  Disorder  (APA,  1994). 

Familial  and  environmental  factors  have  also  been  found 
to  be  associated  with  this  disorder.   Marital  discord  and 
parental  psychopathology  (e.g.,  maternal  depression, 
parental  history  of  behavior  problems,  and  parental 
Attention-Deficit/Hyperactivity  Disorder)  are  more  commonly 
found  in  families  with  a  child  diagnosed  with  Oppositional 
Defiant  Disorder  (APA,  1994;  Dumas  &  Serketich,  1994;  Griest 
S  Forehand,  1982)  . 

Additional  factors  such  as  maternal  "insularity"  and 
socio-economic  disadvantage  also  have  been  identified  as 
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characteristic  of  a  subset  of  families  in  which  a  child  is 
clinic-referred  for  significant  behavior  problems.    Wahler 
(1980)  described  some  mothers  of  children  with  behavior 
problems  as  "insular"  after  noting  a  pattern  of  social 
isolation  from  peers  and  primarily  negative,  coercive  social 
exchanges  in  the  mothers'  lives.   In  one  such  study,  59%  of 
mothers  of  clinic-referred  children  (29  out  of  49)  were 
classified  as  insular  (Dumas  &  Wahler,  1983).   Given  that 
insularity  is  not  routinely  measured  in  the  mothers  of 
clinic-referred  children,  it  is  unclear  to  what  extent  this 
characteristic  is  associated  with  behavior  disorders  in 
children  in  general.   However,  the  results  of  studies 
indicate  that  insularity  is  associated  with  the  development 
of  behavior  problems,  with  higher  drop-out  rates  from 
treatment,  and  with  poorer  maintenance  of  positive  treatment 
outcome  (Wahler,  1980;  Dumas  &  Wahler,  1983). 

Socio-economic  disadvantage  also  appears  to  be  a 
consistent  characteristic  of  a  subset  of  the  families  with 
behaviorally  disordered  children.   Dodge,  Pettit,  and  Bates 
(1994)  found  that  in  a  sample  of  585  children  followed  from 
kindergarten  to  third  grade  there  was  a  linear  relationship 
between  the  risk  of  developing  behavior  problems  and  lower 
SES.   In  a  1984  treatment  outcome  study  of  clinic-referred 
samples  of  children  with  behavior  problems,  Dumas  found  that 
a  significant  portion  of  the  families  (approximately  50%) 
were  classified  in  the  high  socio-economic  disadvantage 


range  based  on  factors  such  as  income  and  maternal 
education.   Socio-economic  disadvantage  appears  to  be 
related  not  only  to  the  increased  incidence  of  behavior 
problems  in  children  but  also  appears  to  be  negatively 
related  to  outcome  in  treatment.   In  Dumas 's  1984  study,  he 
found  that  children  in  the  high  disadvantage  families  were 
more  likely  not  to  succeed  in  a  standard  treatment  program 
(i.e.,  parent  training)  and  were  more  likely  to  demonstrate 
a  higher  level  of  aversive  behavior  in  treatment  and  follow- 
up  than  children  who  were  successful  in  treatment.   In  the 
group  of  families  who  were  unsuccessful  in  treatment,  the 
mothers  (who  were  predominantly  in  the  high  disadvantage 
group)  were  more  aversive  and  more  indiscriminate  in  their 
use  of  aversive  behavior  towards  their  children  than  the 
successful  mothers  at  pre-  and  post-treatment  as  well  as  at 
follow-up.    These  studies  suggest  that  behavioral  problems 
in  children  frequently  occur  within  the  context  of  familial 
and  environmental  stressors  and  that  the  greater  these 
stressors,  the  more  likely  the  children  will  have  poorer 
outcome  in  response  to  parent  training,  the  conventional 
treatment  for  behavior  disorders  (Dumas,  1984).   The 
relationship  between  these  familial  and  environmental 
stressors  and  the  development  of  behavior  problems  has  yet 
to  be  determined.   However,  Dumas 's  work  indicated  that 
specific  interaction  patterns  differentiated  the  families 
with  lower  socio-economic  status  from  those  families  with 
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higher  socioeconomic  status  which  may  account  for  the 
greater  numbers  of  lower  status  families  in  clinic-referred 
groups. 

In  addition  to  familial  and  environmental  factors, 
specific  behaviors  and  interaction  patterns  have  also  been 
found  to  distinguish  children  with  significant  behavior 
problems  from  non-referred  children.   Although  a  variety  of 
behavioral  coding  systems  have  been  employed  to  study 
children  with  behavior  problems  and  their  families,  several 
distinguishing  features  of  these  families  have  been 
consistently  found.   The  most  frequently  replicated  feature 
that  separates  the  behavior  of  children  with  significant 
behavior  problems  from  normal  children  is  their  rate  of 
noncompliance.   In  a  survey  of  43  studies  of  home 
observations  of  conduct  disordered  children,  77%  of  the 
studies  used  coding  systems  that  included  some  measure  of 
compliance/noncompllance  (Mclntyre,  Bornstein,  Isaacs,  et 
al.,  1983).   In  the  studies  that  included  a  normal 
comparison  group,  compliance  was  found  to  be  significantly 
different  between  the  conduct-disordered  and  the  control 
children.   Griest,  Forehand,  Wells,  and  McMahon  (1980)  found 
that  percent  compliance  to  "alpha"  commands  (i.e.,  commands 
for  motoric  behavior  for  which  the  child  has  an  opportunity 
to  comply)  for  clinic-referred  children  was  79.8%  compared 
to  86.2%  for  the  non-referred  children  (p  <  .05). 
Similarly,  Robinson  and  Eyberg  (1981)  found  that  children 
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referred  for  behavior  problems  had  48%  compliance  to 
commands  compared  to  62%  compliance  for  non-referred 
children  (p  <  .01).   Eyberg,  Boggs,  and  Algina  (1995)  found 
that  baseline  rates  of  compliance  were  21%  for  an  initial 
treatment  group  and  19%  for  a  wait  list  group  of  clinic- 
referred  children. 

Their  rate  of  inappropriate  behaviors  is  another 
distinguishing  feature  of  children  with  behavior  problems. 
Robinson  and  Eyberg  (1981)  found  that  the  children  with 
behavior  problems  were  more  likely  than  non-referred 
children  to  whine  and  yell.   Other  investigators  have  also 
documented  significant  differences  in  the  frequency  of 
whining  between  groups  (Mclntyre,  Bornstein,  Isaacs,  et  al., 
1983;  Lobitz  &  Johnson,  1975).   Robinson  and  Eyberg  (1981) 
found  that  total  inappropriate  behaviors  (i.e.,  cry,  whine, 
yell,  smart  talk,  destructive)  recorded  during  the  Parent- 
Directed  Interaction  (PDI)  were  1.16  in  ten  minutes  for 
normal  children  and  6.65  in  ten  minutes  for  behavior  problem 
children.   Forster,  Eyberg,  and  Burns  (1990)  found  that 
children  with  conduct  problems  issued  more  commands  during 
the  Child-Directed  Interaction  (CDI)  than  non-referred 
children.   It  is  possible  that  children  who  issue  numerous 
commands  during  play  appear  to  be  "bossy"  to  others,  a 
behavior  that  could  have  a  negative  impact  on  the  child's 
social  interactions. 
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Some  research  indicates  that  children  with  behavior 
problems  display  fewer  prosocial  behaviors  compared  to 
normal  children.   Lobitz  and  Johnson  (1975)  found  that  the 
proportion  of  child  positive  valence  behavior  (i.e.,  laugh, 
approval,  attention,  talk,  nonverbal  interaction,  and 
independent  activity)  to  total  child  behavior  discriminated 
between  children  with  and  without  behavior  problems. 
Forster,  Eyberg,  and  Burns  (1990)  noted  that  children  with 
behavior  problems  were  less  likely  to  use  positive 
verbalizations,  such  as  praise  of  the  parent  and  questions. 
Based  on  clinical  impressions,  Patterson  (1986)  also 
conceptualized  children  with  conduct  problems  as  having 
social  skills  deficits  although  he  did  not  find  significant 
differences  between  groups  of  referred  and  nonreferred 
children  on  behaviors  such  as  laugh,  attend,  approval,  and 
physical  positive. 

Two  types  of  parental  verbal  behavior  have  been  found 
to  consistently  characterize  parents  of  children  with 
behavior  problems.  First,  the  frequency  of  parental  commands 
has  been  shown  to  distinguish  families  of  non-referred 
children  from  families  of  children  referred  for  behavior 
problems  (Lobitz  8  Johnson,  1975;  Rogers,  Forehand,  & 
Griest,  1981).   Webster-Stratton  (1985)  found  that  the 
frequency  and  type  of  command  differentiated  the  two  groups 
of  parents.   Mothers  of  clinic-referred  children  were 
observed  to  give  both  indirect  (e.g.,  "will  you  sit  down?") 
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and  direct  commands  (e.g.,  "Sit  down.")  more  frequently  and 
to  repeat  commands  before  the  child  had  sufficient 
opportunity  to  comply.   Similarly,  direct  commands  were 
significantly  higher  for  parents  of  children  with  behavior 
problems  during  PDI  and  CDI  (Robinson  &  Eyberg,  1981). 

Secondly,  parents  of  clinic-referred  children  differ 
from  parents  of  non-referred  children  on  the  frequency  of 
their  negative  verbal  behavior.   Robinson  and  Eyberg  (1981), 
Webster-Stratton  (1985),  and  Aragona  and  Eyberg  (1981)  found 
that  parents  of  clinic-referred  children  issued 
significantly  more  critical  statements.   Similarly,  Lobitz 
and  Johnson  (1975)  found  that  the  parents  of  referred 
children  significantly  differed  from  the  parents  of  non- 
referred  children  on  a  summary  variable  of  negative 
behaviors  which  included  threatening  commands,  negative 
commands,  disapproval,  ignoring,  and  physical  negative. 
Overall,  these  studies  indicate  that  children  with 
behavior  problems  have  significantly  higher  rates  of 
noncompliance,  have  higher  rates  of  inappropriate  behaviors, 
and  emit  fewer  prosocial  behaviors.   Parents  of  children 
with  behavior  problems  issue  significantly  more  commands  and 
more  negative  verbalizations,  such  as  criticism.   Behavioral 
observation  systems  intended  to  assess  children  with  conduct 
problems  should  include  categories  known  to  differ  between 
children  with  and  without  clinically  significant  behavioral 
problems . 
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The  Dyadic  Parent-Child  Interaction  Coding  System 

The  Dyadic  Parent-Child  Interaction  Coding  System 
(DPICS)  (Eyberg  8  Robinson,  1983)  is  a  widely  used  system 
that  allows  for  efficient  direct  observation  of  parent-child 
interactions  in  a  standardized  laboratory  setting  using  a 
reliable  and  valid  method.   The  DPICS  was  designed  for  both 
research  and  clinical  purposes.   The  system  was  intended  to 
provide  practicing  clinicians  with  a  manageable  and 
practical  way  to  measure  pre-  and  posttreatment  changes  and 
on-going  treatment  progress.   At  the  same  time,  the  DPICS 
was  intended  to  provide  researchers  with  a  reliable  and 
valid  system  that  measures  behaviors  with  sufficient  detail 
and  specificity  to  advance  our  knowledge  in  the  treatment 
and  assessment  of  behaviorally  disordered  children. 

Some  of  the  basic  categories  of  the  DPICS,  such  as 
direct  and  indirect  commands,  labeled  and  unlabeled  praise, 
physical  positive  and  negative,  and  critical  statements, 
were  originally  derived  from  the  Hanf  (1968)  and  Patterson 
(1969)  coding  systems.   Additional  categories  including 
descriptive  statements,  acknowledgments,  and  irrelevant 
verbalizations,  were  included  in  the  DPICS  to  allow  for 
continuous  coding  of  all  parental  verbal  behaviors.   The 
system  also  contained  categories  to  assess  children's 
inappropriate  behaviors  (e.g.,  yell,  whine,  cry, 
destructive,  and  smart  talk).   Two  sequences  of  behaviors 
were  coded:  1)  the  parent's  response  to  inappropriate  child 
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behavior  and  2)  the  child's  response  to  parental  commands 
(i.e.,  compliance,  noncompliance,  or  no  opportunity  for 
compliance).   The  coding  system  was  gradually  developed  and 
improved  using  feedback  from  users  of  the  system  from  1974 
until  its  publication  in  1983.   The  1983  version  contains  a 
total  of  22  parent  and  child  behavior  categories  (Table  1 ) . 
The  system  continued  to  be  evaluated  and  refined  by  its 
users.   For  example,  Wruble,  Sheeber,  Sorenson,  et  al. 
(1991)  evaluated  the  procedure  for  coding  child  compliance, 
verifying  the  use  of  the  5-second  interval  for  compliance 
through  observation  of  compliance  times  in  non-referred 
children. 

DPICS  observations  are  generally  conducted  in  a 
laboratory  or  clinic  setting.   For  laboratory  observation, 
the  parent-child  pair  is  typically  observed  from  behind  a 
one-way  mirror  while  they  play  with  a  standard  set  of  toys 
that  encourages  positive,  interactive  play.   The  parent- 
child  dyads  are  observed  during  three  standard  DPICS 
situations  designed  to  assess  the  quality  of  the  parent  and 
child's  social  interactions.   Each  situation  differs  both  in 
the  amount  of  parental  control  required  and  the  demand 
placed  on  the  child  for  compliance. 

In  the  first  situation,  called  the  Child-Directed 
Interaction  (CDI),  the  parent  is  instructed  to  follow  the 
child's  lead  during  play.   CDI  is  intended  to  place  little 
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Table  1 

Categories  In  the  Dyadic  Parent-Child  Interaction  Coding 
System  (DPICS) 


Parent  Behavior 


Child  Behavior 


Acknowledgment 

Reflective  Statements 

Descriptive  Statements 

Descriptive /Reflective 
Questions 

Indirect  Commands 

Direct  Commands 

Labeled  Praise 

Unlabeled  Praise 

Criticism 


Physical  Negative 
Physical  Positive 


Ignores/Responds  to  deviant 


Smart  Talk 

Yell 

Whine 

Cry 

Physical  Negative 

Physical  Positive 

Destructive 

Compliance 

Noncompliance 

No  Opportunity  for 
Compliance 

Changes  Activity 


Note:   Adapted  from  Eyberg  &  Robinson,  1983. 


demand  on  the  child  for  compliance  and  to  offer  the  parent 
opportunities  to  provide  the  child  with  positive  attention 
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(e.g.,  descriptions,  praises,  answers).   If  the  parent  is 
successful  in  following  the  child's  lead  in  play,  little 
child  noncompliance  and  inappropriate  behavior  is  expected 
to  occur  in  this  situation. 

In  the  second  situation,  the  Parent-Directed 
Interaction  (PDI),  the  parent  is  instructed  to  structure  the 
play  and  attempt  to  get  the  child  to  follow  the  parent's 
direction  and  rules  for  the  play.   In  this  situation,  the 
observers  assess  the  parent's  ability  to  direct  their  child 
and  gain  the  child's  cooperation.   Because  the  PDI  situation 
increases  the  amount  of  parental  control,  it  provides 
observers  with  an  opportunity  to  assess  the  child's  response 
to  directions  (e.g.,  compliance,  inappropriate  behavior). 

In  the  third  situation,  Clean-up  (CU),  the  parent  is 
instructed  to  get  the  child  to  pick  up  the  toys  without 
assistance  and  put  them  into  their  respective  containers. 
The  Clean-Up  situation  requires  the  highest  level  of 
parental  control.   Unlike  the  first  two  play  situations, 
Clean-Up  is  a  task  situation  in  which  it  is  anticipated  that 
parents  will  direct  their  children  using  commands  and 
directive  information  descriptions,  informing  the  child 
about  the  task  demands.   This  situation  provides 
opportunities  to  assess  the  parent's  success  in  gaining 
compliance  from  the  child,  to  assess  inappropriate  behavior 
in  the  child  in  response  to  parental  demands,  and  to  assess 
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compliance  to  the  commands.   The  parents'  use  of  praise  and 
positive  attention  for  compliance  can  also  be  evaluated. 

The  total  time  required  for  comprehensive  baseline  and 
post-treatment  observation  of  a  parent-child  dyad  is 
approximately  25  minutes.   The  CDI  and  PDI  situations  each 
last  approximately  ten  minutes.   The  first  five  minutes  of 
each  of  the  two  play  situations  is  used  as  a  warm-up  and 
transition  period,  and  the  last  five  minutes  in  each  of  the 
two  play  situations  is  coded.   Because  cleaning  up  the  toys 
may  not  require  more  than  a  few  minutes  with  a  compliant 
child,  the  initial  five  minutes  of  the  CO  situation  is 
coded,  after  which  the  observation  session  can  be 
terminated. 

Coding  of  the  dyad  may  be  conducted  "live"  with  the 
observer  coding  during  the  actual  observation  period. 
Clinicians  may  prefer  to  use  selected  categories  when  coding 
"live"  to  assess  behaviors  targeted  for  change. 
Alternatively,  the  parent-child  interactions  can  be 
videotaped  and  coded  at  a  later  date.   The  latter  method  is 
recommended  for  research  purposes. 

In  the  1981  study  to  standardize  and  validate  the  DPICS 
(Robinson  &  Eyberg),  parent-child  dyads  were  observed  in  the 
two  play  situations,  Child-Directed  and  Parent-Directed 
Interaction.   The  standardization  sample  consisted  of  20 
families  who  had  been  referred  to  a  university  child 
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psychology  clinic  for  treatment  of  behavior  problems  and  22 
control  families  recruited  from  the  community. 

The  mean  interrater  reliability  coefficient  for  parent 
behaviors  was  .91  (range,  .67-1.0)  and  for  the  child 
behaviors  was  .92  (range,  .76-1.0).   In  a  discriminant 
analysis,  the  DPICS  variables  were  found  to  classify 
correctly  94%  of  the  families  into  either  the  clinic- 
referred  or  non-referred  group.   The  DPICS  variables  also 
accounted  for  61%  of  the  variance  in  parental  reports  of 
their  children's  behavior  at  home  on  the  ECBI .   Thus,  DPICS 
has  demonstrated  reliability  and  validity  as  an 
observational  system  for  children  with  behavior  problems. 

Since  its  development,  the  DPICS  has  been  widely  used 
both  clinically  and  in  research  to  describe  parent-child 
interactions.   For  example,  the  DPICS  has  been  used  to 
distinguish  between  the  parent-child  interactions  of  mothers 
of  neglected  children,  children  with  behavior  problems,  and 
normal  control  children  (Aragona  &  Eyberg,  1981)  and  abusive 
and  nonabusive  families  (Webster-Stratton,  1985). 
Furthermore,  DPICS  has  been  employed  as  a  measure  of  pre-  to 
post-treatment  changes  for  children  with  behavior  problems 
(Eyberg  &  Robinson,  1982;  Eyberg  &  Matarazzo,  1980; 
Eisenstadt,  Eyberg,  McNeil,  Newcomb,  &  Funderburk,  1993). 

Dyadic  Parent-Child  Interaction  Coding  System  II 
Recently,  the  DPICS  has  been  expanded  and  revised.   The 
new  version,  DPICS  II,  shares  many  similarities  with  the 
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original  system  including  use  of  the  same  observation 
procedures  (i.e.,  CDI,  PDI,  and  CU)  and  retention  of  many  of 
the  original  categories  (Eyberg,  Bessmer,  Newcomb,  Edwards, 
&  Robinson,  1994).   The  expanded  version  contains  twenty- 
five  categories  for  child  behavior  and  twenty-seven 
categories  for  parent  behavior  (See  Appendix  B:   Summary  of 
DPICS  II  Categories).   The  DPICS  II  differs  from  the 
previous  version  in  two  major  ways.   First,  the  rules  or 
guidelines  for  coding  behaviors  have  been  clarified  and 
expanded  based  upon  feedback  from  users  of  the  DPICS.   In 
the  manual  for  the  DPICS  II,  the  descriptions  of  the 
categories  are  followed  by  more  detailed  guidelines  to 
facilitate  accurate  coding  and  by  a  greater  variety  of 
examples  of  parent  and  child  behaviors  to  illustrate  the 
coding  principles.   Attempts  have  been  made  by  the  authors 
to  operationalize  the  coding  criteria  to  a  greater  degree  to 
reduce  and/or  eliminate  subjective  judgments  by  the  coders 
whenever  possible.   For  verbalizations,  coding  rules  were 
often  based  on  grammatical  properties  of  the  words  used 
rather  than  on  assumptions  about  the  intended  meaning  of  the 
words.   For  vocalizations  and  nonverbal  behaviors,  the 
coding  rules  were  designed  to  provide  sufficient  observable 
behavioral  criteria  to  facilitate  reliable  coding. 

The  second  major  change  involved  the  addition  of 
several  behavioral  categories  and  the  removal  of  several 
other  categories.   Table  2  lists  the  original  categories  of 


Table  2 

Categories  of  the  DPICS  and  DPICS  II 


21 


Parent  Behavior 


Child  Behavior 


Playtalk 

Acknowledgment 
Behavioral  Description3 
Information  Description3 

Reflective  Statements 

Descriptive /Reflective 
Questions 

Information  Questions 

Indirect  Commands 

Direct  Commands 

Labeled  Praise 

Unlabeled  Praise 

Criticism 

Smart  Talk 

Yell 

Whine 

Laugh 

Physical  Negative 

Physical  Positive 

Destructive 

Compliance 

Noncompl i  ance 

No  Opportunity  for 
Compliance 

Answer 

No  Answer 

No  Opportunity  for  Answer 

Contingent  Labeled  Praise 

Warning 


Playtalk 

Acknowledgment 

Behavioral  Description 

Information  Description 

Reflective  Statements 

Descriptive/Reflective 
Questions 

Information  Questions 

Indirect  Commands 

Direct  Commands 

Labeled  Praise 

Unlabeled  Praise 

Criticism 

Smart  Talk 

Yell 

Whine 

Laugh 

Physical  Negative 

Physical  Positive 

Destructive 

Compliance 

Noncompliance 

No  Opportunity  for 
Compliance 

Answer 

No  Answer 

No  Opportunity  for  Answer 


In  DPICS,  descriptions  were  coded  Descriptive  Statement. 
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the  DPICS  along  with  the  categories  that  have  been  added  in 
DPICS  II,  which  are  shown  in  bold  typeface.   While  DPICS 
focused  on  behaviors  that  seemed  most  salient  for  assessment 
and  treatment  (i.e.,  frequency  of  the  child's  inappropriate 
behaviors,  such  as  noncompliance,  frequency  of  parents' 
praise,  commands,  and  criticism),   in  the  DPICS  II,  the 
categories  for  child  and  parent  behaviors  have  been  designed 
to  be  reflexive,  in  that  the  same  verbal  and  motor  behaviors 
are  coded  for  both  the  parent  and  child.   Although  this 
change  greatly  expands  the  total  number  of  categories  in  the 
system,  the  reflexive  nature  of  the  parent  and  child 
categories  enables  coders  to  learn  one  set  of  rules  for  the 
categories  which  then  apply  to  both  the  parent  and  child 
behaviors . 

By  allowing  coding  of  the  same  behaviors  for  parents 
and  children,  DPICS  II  may  be  a  more  useful  research  and 
clinical  tool.    It  is  possible  for  clinicians  and 
researchers  to  use  the  DPICS  II  to  describe  behaviors  within 
the  interaction  that  may  elicit  or  maintain  the  children's 
behavior  problems  and  assess  changes  in  these  behaviors 
during  and  after  treatment.   For  example,  parents'  modeling 
of  inappropriate  behaviors  may  be  associated  with  the 
children's  use  of  these  inappropriate  behaviors. 
Specifically,  parents'  use  of  critical  statements  and  smart 
talk  may  be  associated  with  higher  levels  of  criticisms, 
smart  talk,  whine,  and  yell  in  their  children. 
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In  addition  to  inappropriate  behaviors,  the  DPICS  II 
may  also  be  useful  in  assessing  socially  appropriate 
behaviors.   Because  children  with  behavior  problems  have 
been  found  to  be  less  socially  competent  than  non-referred 
children  (La  Freniere,  Dumas,  Capuano,  S  Dubeau,  1992), 
categories  for  coding  child  appropriate  verbalizations  are 
included  to  allow  researchers  and  clinicians  to  use  the 
DPICS  II  to  examine  the  child  behaviors  related  to  prosocial 
skills. 

Users  of  the  original  DPICS  will  note  several  new 
categories,  and  other  categories  from  the  original  system 
have  been  divided  into  smaller  units.   Playtalk,  for 
example,  a  category  that  previously  has  been  used  only  in 
research  (Forster,  Eyberg,  and  Burns,  1984;  Mee,  1991),  is 
intended  to  capture  indirect  communication  in  the  form  of 
parent  and  child  verbalizations  that  are  spoken  as  if  by 
characters  in  their  game.   Forster  Eyberg,  and  Burns  (1990) 
and  Speltz,  DeKlyen,  Greenberg,  &  Dryden  (1995)  found  that 
Playtalk  was  more  frequent  in  families  with  conduct  problem 
children.   In  contrast,  Mee  (1991)  found  very  low  rates  of 
Playtalk  in  a  group  of  children  with  behavior  problems; 
however,  low  reliability  for  this  category  found  in  Mee's 
study  may  account  for  her  findings.   Further  study  of 
Playtalk,  provided  it  can  be  coded  reliably,  appears 
warranted  given  these  mixed  findings. 
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The  DPICS  categories  of  Descriptive  Statements  and 
Descriptive/Reflective  Questions  have  each  been  divided  into 
two  categories.   The  subdivision  of  the  original  categories 
was  intended  to  capture  differences  in  the  directiveness 
and/or  attentiveness  communicated  in  the  verbalization.   The 
Descriptive  Statements  category,  for  example,  was  divided 
into  Behavioral  Descriptions,  (i.e.,  statements  that  follow 
the  other  person  by  directly  describing  the  on-going  or 
immediately  completed  behavior  of  the  other  member  of  the 
dyad),  and  Information  Descriptions,  (i.e.,  statements  that 
describe  aspects  of  the  play  situation  (e.g.,  toys, 
feelings,  behaviors  of  the  speaker)  that  need  not  be  related 
to  the  behavior  of  the  other  member  of  the  dyad).   The  DPICS 
category  of  Descriptive/Reflective  Question  also  has  been 
divided  into  two  types  of  questions:  (a)  Information 
Questions  that  request  a  verbal  response  from  the  listener 
that  is  more  than  an  acknowledgment,  and  (b) 

Descriptive/Reflective  Questions  that  require  no  more  than  a 
brief  verbal  acknowledgment  from  the  listener. 

The  description  and  question  categories  were  divided  to 
enable  separate  recordings  of  components  of  interactions 
that  may  be  directive  or  coercive  and  have  a  higher 
likelihood  of  eliciting  noncompliance  or  inappropriate 
behavior  in  children.   The  division  of  these  categories  is 
intended  to  allow  researchers  and  clinicians  to  examine 
further  the  maladaptive  interactions  that  distinguish 
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children  with  behavior  problems  and  their  parents  from 
families  in  which  these  difficulties  are  not  reported. 

In  addition  to  research  applications,  the  DPICS  II  is 
helpful  in  clinical  settings  as  a  way  to  monitor  parents' 
use  of  directive  and  non-directive  verbal  behaviors 
frequently  taught  in  behavior  management  treatment  programs 
for  young  children.   The  DPICS,  and  more  recently  the  DPICS 
II,  have  been  used  as  an  assessment  device  for  Parent-Child 
Interaction  Therapy  (PCIT),  a  parent  training  program 
designed  to  treat  children  with  behavior  problems  and  their 
parents  (Eyberg,  1979,  1988;  Hembree-Kigin  &  McNeil,  1995). 
It  is  anticipated  that  some  of  the  categories,  such  as 
Contingent  Labeled  Praise,  Behavioral  Descriptions,  and 
Labeled  Praise,  will  occur  infrequently  in  parents  who  have 
not  received  skills  training.   However,  inclusion  of  these 
categories  will  enable  clinicians  and  researchers  to  use  the 
DPICS  II  to  assess  positive  attending  skills  in  parents, 
such  as  praise  and  descriptions,  during  and  after  treatment. 

Some  additional  categories  in  the  system  may  provide 
more  information  about  important  sequences  of  behavioral 
events  in  parent-child  interactions.   Whereas  the  DPICS 
allowed  for  coding  of  two  sequences,  parental  response  to 
deviant  child  behavior  and  child  compliance  to  parental 
commands,  the  DPICS  II  allows  several  additional  sequences 
to  be  measured  in  the  interaction.   For  example,  parental 
Labeled  Praise  following  child  Compliance  to  commands  is  now 
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coded  as  Contingent  Labeled  Praise,  and  whether  a  question 
requesting  information  has  been  answered  appropriately  or 
not  also  can  be  recorded.   This  sequential  information  may 
be  helpful  in  determining  the  amount  of  reciprocity  in  the 
dyad  and  may  be  a  feature  of  parent-child  dyads  that 
distinguishes  clinic-referred  families  from  normal  families. 

Finally,  several  categories  contained  in  the  original 
system  have  been  removed.   Reasons  for  removing  categories 
included  poor  interobserver  agreement,  infrequency  of  the 
behavior  and  lack  of  utility  of  the  category.   Parent 
categories  that  are  no  longer  contained  in  the  system  are 
Irrelevant  Verbalization,  Responds  to  (child)  Deviant, 
Ignores  (Child)  Deviant.   Child  categories  that  have  been 
eliminated  are  Change  Activity  and  Cry. 

One  study  has  examined  the  reliability  of  a  subset  of 
the  DPICS  II  categories  which  comprise  the  Clinic  Version  of 
the  DPICS  II.   Bessmer  (1993)  examined  the  reliability  of 
the  parent  verbalization  categories,  the  child  inappropriate 
behavior  categories,  the  child  response  to  commands 
categories  and  the  child  response  to  Information  Questions 
categories  in  a  sample  of  20  nonreferred  mother-child  dyads 
recruited  from  the  Gainesville,  FL,  community.   To  be 
included  in  the  study  the  children  had  to  fall  within  the 
normal  range  on  the  Problem  Score  of  the  Eyberg  Child 
Behavior  Inventory  (less  than  11)  (Eyberg  &  Ross,  1978). 
The  dyads  were  coded  "live"  rather  than  from  videotape,  and 


27 
reliability  estimates  were  obtained  using  Pearson  product- 
moment  correlations,  percent  agreement  on  occurrence  only, 
and  Cohen's  kappa  (Cohen,  1960)  for  the  CDI  and  PDI 
situations  as  summarized  in  Tables  3  and  4  in  Appendix  A. 
Information  Question,  Descriptive/Reflective  Question, 
Behavioral  Description,  Acknowledgment,  and  Play talk 
categories  in  CDI  demonstrated  excellent  reliability  (i.e., 
correlations  and  percent  agreement  >  .80  and  kappa  >  .75). 
The  parent  categories  with  good  to  fair  reliability 
estimates  (correlations  and  percent  agreement  >  .60  and 
kappa  >  .40)  were  Direct  Command,  Indirect  Command, 
Information  Description,  Reflective  Statement,  and  Unlabeled 
Praise.   Labeled  Praise  and  Criticism/Smart  Talk  had  poor 
reliability  estimates  during  the  CDI  situation. 

In  the  PDI  situation  shown  in  Table  4  in  Appendix  A, 
Information  Question,  Unlabeled  Praise,  and  Play talk  had 
excellent  reliability.   The  categories  with  good  to  fair 
reliability  estimates  were  Direct  Command,  Indirect  Command, 
Descriptive/Reflective  Question,  Information  Description, 
Reflective  Statement,  Acknowledgment,  and  Criticism/Smart 
Talk.   The  categories  with  poor  reliability  were  Behavioral 
Description  and  Labeled  Praise. 

On  all  measures  of  reliability,  the  child  categories  of 
Answer  and  No  Opportunity  for  Answer  had  excellent 
reliability  during  CDI  (See  Table  5  in  Appendix  A).   If  two 
out  of  three  methods  of  calculating  reliability  are 
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considered,  Compliance,  Noncompliance  and  No  Opportunity  for 
Compliance  appeared  highly  reliable.   No  Answer  appeared  to 
have  good  to  fair  reliability  estimates.   Possibly  as  a 
result  of  the  infrequency  of  the  behaviors  they  measure,  the 
other  child  categories  demonstrated  poor  reliability. 

In  the  PDI  situation,  the  categories  of  Compliance,  No 
Opportunity  for  Compliance,  Answer,  and  No  Opportunity  for 
Answer  were  highly  reliable  (See  Table  6  in  Appendix  A). 
Noncompliance  and  No  Answer  had  fair  to  good  reliability 
across  the  three  methods.   Similar  to  the  results  in  CDI, 
the  child  inappropriate  behavior  categories  occurred  rarely 
or  never,  yielding  no  estimate  or  very  low  estimates  of 
reliability. 

The  Bessmer  (1993)  study  provided  reliability 
information  about  the  categories  in  the  Clinic  version  of 
DPICS  II  using  live  coding  of  a  normal  sample  of  mother- 
child  dyads.   That  study  showed  that  many  of  the  categories 
could  be  reliably  coded.   Because  a  non-referred  sample  is 
likely  to  exhibit  some  of  the  behaviors  measured  by  the 
DPICS  II  at  extremely  low  rates,  or  not  at  all,  the 
reliability  of  some  of  the  behavioral  categories  could  not 
be  examined.   Low  reliability  estimates  were  obtained  for 
categories  such  as  Labeled  Praise,  Behavioral  Description, 
and  Criticism/Smart  Talk.   These  low  estimates  were  likely 
influenced  by  the  very  low  frequency  of  occurrence  and  may 
not  represent  a  fair  evaluation  of  the  reliability  of  these 
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categories  if  examined  under  different  conditions.   In 
addition,  many  of  the  child  inappropriate  behaviors  were  not 
coded  in  any  of  the  dyads,  making  computation  of  reliability 
estimates  impossible.   To  obtain  information  about  the 
reliability  of  the  DPICS  II  categories  that  would  occur  with 
a  clinic  sample,  the  reliability  of  the  categories  needs  to 
be  evaluated  in  a  sample  of  children  with  significant 
behavior  problems. 

Preliminary  information  on  the  validity  of  the  DPICS  II 
categories  was  obtained  in  a  pilot  study  (Bessmer  &  Eyberg, 
1993)  which  compared  the  20  non-referred  mother-child  dyads 
used  in  the  Bessmer  study  to  a  sample  of  20  mother-child 
dyads  referred  for  treatment  of  Oppositional  Defiant 
Disorder.   The  two  groups  were  not  significantly  different 
on  demographic  characteristics  such  as  age,  sex,  and  race  of 
the  children.   The  two  groups  were  found  to  be  significantly 
different  on  socio-economic  status  (SES)  level  using 
Hollingshead' s  Four  Factor  Index  of  Social  Status 
(Hollingshead,  1975).   The  non-referred  group  obtained  a 
mean  SES  score  of  51.5  while  the  clinic-referred  group 
obtained  a  mean  score  of  35.5.   The  differences  in  SES  level 
are  likely  related  to  the  high  level  of  education  in  the 
non-referred  sample  which  was  recruited  from  a  university 
community.   The  two  groups  of  children  also  differed 
significantly  on  their  mean  standard  score  on  the  Peabody 
Picture  Vocabulary  Test — Revised  (PPVT-R),  but  were  each 
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within  one  standard  deviation  of  the  normative  mean,  as 
shown  in  Table  7.   As  expected,  the  two  groups  differed 
significantly  on  the  Eyberg  Child  Behavior  Inventory  (ECBI), 
a  measure  of  behavior  problems. 

Table  7 

Scores  on  Measures  Used  to  Screen  Dvads 


Normative   Referred  Nonreferred 

M  M  M 

(SD)        (SD)        (SD) 


PPVT-R  Standard  Score 

100a 
15a 

95.2 

(13.7) 

106.89* 
(14.02) 

ECBI  Problem  Score 

7b 
(8)b 

22.2 
(6.6) 

3.75** 
(2.73) 

ECBI  Intensity  Score 

97b 
(35)b 

171.5 
(27.4) 

98.8** 
(16.77) 

Note:   Significance  levels  refer 

to  compa: 

cisons  between 

referred  and  non-referred  samples  in  the  Bessmer  and  Eyberq 
pilot  study  (1993) . 

3  (Dunn*§  Dunn'  1981);  b(Colvin,  Eyberg,  &  Adams,  1996);  *  p 
<  .01;    p  <  .001; 


The  mean  frequency  of  occurrence  of  the  DPICS  II 
categories  in  the  Clinic  version  were  compared  for  the  two 
groups  using  multiple  t  tests.   The  complete  results  of  the 
t  tests  are  reported  in  Tables  8-11  in  Appendix  A.   The 
comparisons  of  the  two  groups  revealed  significant 
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differences  during  the  CDI  situation  on  the  parent 
categories  of  Information  Description  and  Acknowledgment. 
During  the  PDI  situation,  the  parent  categories  of  Direct 
Command,  Information  Description,  Acknowledgment,  Unlabeled 
Praise,  Criticism/Smart  Talk,  and  Playtalk  were 
significantly  different  between  groups.   Fewer  differences 
were  observed  in  the  child  categories.   In  the  CDI 
situation,  there  were  no  significant  differences  between 
groups  on  the  child  categories,  and  in  the  PDI  situation, 
only  the  child  behavior  category  of  Noncompliance  was 
significant.   The  summary  variable  of  Total  Inappropriate 
Behavior  also  was  significantly  different  between  groups  in 
PDI. 

The  differences  between  the  two  groups  in  the  parent 
and  child  categories  during  PDI  are  consistent  with  the 
literature  on  children  with  behavior  problems.   In  general, 
behaviorally  disordered  children  displayed  significantly 
more  inappropriate  behavior  and  were  significantly  more 
noncompliant  than  non-referred  children.   The  parents  of 
children  with  behavior  problems  issued  more  commands  and 
more  critical  statements  than  parents  of  nonreferred 
children. 

In  this  pilot  study,  non-referred  parents  were  found  to 
provide  more  Information  Descriptions  and  Acknowledgments 
during  CDI  and  PDI  and  more  Unlabeled  Praise  during  PDI . 
These  findings  suggested  that  non-referred  parents  were  more 
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interactive,  positive,  and  responsive  to  their  children  than 
the  parents  of  clinic-referred  children.   While  these  data 
support  the  validity  of  the  DPICS  II  in  discriminating 
between  clinic-referred  and  non-referred  dyads,  the 
demographic  confounds  and  the  multiple  t  tests  may  have 
accounted  for  some  of  the  findings  and  these  results  should 
be  considered  preliminary. 

A  further  investigation  of  the  relationship  between 
DPICS  II  categories  and  the  child's  SES  and  PPVT-R  scores 
was  completed  because  of  the  significant  differences  between 
groups  found  on  these  characteristics.   The  correlations 
between  SES,  PPVT-R  scores  and  DPICS  II  variables  relevant 
to  the  present  study  were  computed  on  a  sample  of  clinic- 
referred  subjects  (N  =  47)  drawn  from  the  treatment  outcome 
study  subjects.   The  correlation  matrices  for  these  analyses 
are  presented  in  Tables  12  and  13  in  Appendix  A. 
Significant  correlations  were  found  between  SES  and  several 
child  behavior  categories:  1)  Noncompliance  in  CDI  (r  =  - 
.31);  2)  Smart  Talk  in  PDI  and  CU  (r  =  -.31  and  -.36, 
respectively);  3)  No  Opportunity  for  Compliance  in  CDI  (r  = 
-.40);  and  4)  Criticism  in  CU  (r  =  -.40). 

Significant  correlations  also  were  found  between  SES 
and  several  parent  categories:  1)  Direct  Command  in  CDI  (r  = 
-.42)  and  CU  (r  =-.30);  2)  Criticism  in  CDI  (r  =  -.29).    No 
significant  correlations  were  found  between  SES  and  child 
Yell,  whine,  Destructive,  Physical  Negative,  and  Compliance 
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nor  were  any  correlations  significant  between  SES  and  the 
parent  categories  of  Indirect  Command  and  Labeled  Praise. 
Given  that  a  large  number  of  correlations  were  performed, 
some  significant  findings  were  expected  based  on  chance. 
However,  for  some  DPICS  variables,  significant  correlations 
with  SES  occurred  in  more  than  one  situation,  suggesting 
that  the  frequency  of  occurrence  of  those  variables  may  vary 
as  a  function  of  SES.   Parent  Direct  Command  and  child  Smart 
Talk,  specifically,  appeared  to  be  related  to  SES.   These 
findings  indicate  that  SES  may  be  associated  with  some  the 
categories  in  the  DPICS  II.   Further  analyses  using  the 
DPICS  II  variables  should  evaluate  the  effects  of  SES  in 
relation  to  the  categories.   No  significant  correlations 
between  child  PPVT-R  standard  scores  and  selected  DPICS  II 
variables  were  found,  indicating  that  these  variables  are 
not  related  to  the  child's  receptive  vocabulary  level. 

The  purpose  of  the  present  study  was  to  examine  the 
reliability  and  validity  of  the  research  version  of  the 
DPICS  II  by  comparing  videotaped  interactions  of  mother- 
child  dyads  in  which  the  child  was  referred  to  a  psychology 
clinic  for  behavior  problems  to  non-referred  mother-child 
dyads.   Reliability  was  assessed  using  intraclass 
correlations,  percent  agreement,  and  kappa.   Validity  was 
examined  by  evaluating  the  degree  to  which  the  DPICS  II 
categories  discriminated  between  clinic-referred  and  non- 
referred  dyads.   In  addition,  the  association  between  the 
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DPICS  II  categories  and  the  ECBI,  the  PSI,  and  the  PLOC, 
measures  which  have  been  shown  to  discriminate  between 
clinic-referred  and  non-referred  children,  was  used  to 
demonstrate  the  convergent  validity  of  the  coding  system  for 
use  in  evaluating  children  with  behavior  problems. 

Hypotheses 
Based  upon  previous  studies  using  DPICS  with  children 
with  behavior  problems,  the  following  hypotheses  were  made: 

1 .  Parent-child  interactions  can  be  reliably  coded  using 
the  DPICS  II,  as  measured  by  intraclass  correlations, 
percentage  of  interrater  agreement  and  Cohen's  kappa. 

2.  The  DPICS  II  will  demonstrate  discriminant  validity  for 
use  with  children  with  behavior  problems  by  replicating 
the  previous  findings  about  children  with  behavior 
problems  and  their  mothers: 

a.  Children  who  have  been  referred  for  behavior 
problems  will  have  significantly  higher  rates 
of  noncompliance  compared  to  non-referred 
children . 

b.  The  referred  children  will  have  significantly 
higher  frequencies  on  the  summary  variable, 
Total  Inappropriate  Behaviors,  which  includes 
the  categories  Destructive,  Physical 
Negative,  Yell,  Whine,  Smart  Talk,  and 
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Criticism,  compared  to  children  in  the 
comparison  group. 

c.  The  referred  children  will  demonstrate  fewer 
prosocial  behaviors;  specifically,  they  will 
have  a  lower  rate  of  Total  Prosocial 
Behaviors  (Answer  +  Acknowledgment  +  Laugh  + 
Information  Descriptions  +  Behavioral 
Descriptions  +  Physical  Positive  +  Labeled 
Praise  +  Unlabeled  Praise). 

d.  Mothers  of  children  with  behavior  problems 
will  have  a  higher  total  number  of  commands 
and  a  higher  direct  command  ratio  (Direct 
Commands/ (Indirect  +  Direct  Commands).   In 
addition,  mothers  of  clinic-referred  children 
will  display  significantly  fewer  Total 
Prosocial  Behaviors  (Acknowledgment  +  Answer 

+  Information  Description  +  Behavioral 
Description  +  Laugh  +  Labeled  Praise  + 
Unlabeled  Praise  +  Reflection  +  Physical 
Positive) . 

e.  Mothers  of  clinic-referred  children  will  have 
a  higher  rate  of  Negative  Talk  (Criticisms  + 
Smart  Talk)  and  Total  Inappropriate  Behavior 
(Criticisms  +  Smart  Talk  +  Yell  +  Whine  + 
Destructive  +  Physical  Negative)  compared  to 
the  mothers  of  non-referred  children. 
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3.  The  DPICS  II  categories  and  summary  variables  of  Child 
Noncompliance,  Child  Total  Inappropriate  Behavior, 
Child  Prosocial  Behavior,  Parent  Total  Inappropriate 
Behavior,  Parent  Direct  Command  Ratio,  and  Parent  Total 
Commands  will  demonstrate  discriminant  validity  by 
correctly  classifying  dyads  into  their  respective 
groups  (i.e.,  clinic-referred  and  non-referred)  in  a 
discriminant  function  analysis. 

4.  The  DPICS  II  categories  and  summary  variables  of  Child 
Noncompliance,  Child  Total  Inappropriate  Behavior, 
Child  Prosocial  Behavior,  Parent  Inappropriate 
Behavior,  Parent  Direct  Command  Ratio,  and  Parent  Total 
Commands  will  demonstrate  convergent  validity  by 
accounting  for  a  significant  proportion  of  the 
variance  in  ECBI  intensity  scores. 

5.  The  DPICS  II  categories  and  summary  variables  for  child 
behavior  (i.e.,  Noncompliance,  Total  Inappropriate 
Behavior,  Prosocial  Behavior)  will  demonstrate 
convergent  validity  by  accounting  for  a  significant 
proportion  of  the  variance  in  PSI  child  domain  scores. 

6.  The  DPICS  II  categories  and  summary  variables  for 
parents  (i.e.,  Direct  Command  Ratio,  Total  Commands, 
Inappropriate  Behavior,  Prosocial  Behavior)  will 
demonstrate  convergent  validity  by  accounting  for  a 
significant  proportion  of  the  variance  in  PSI  parent 
domain  scores.   In  a  separate  analysis,  these  parent 
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categories  and  summary  variables  will  account  for  a 
significant  proportion  of  the  variance  in  the  total 
PLOC  score. 


METHODS 
Participants 
Two  groups  of  30  mother-child  dyads,  a  clinic-referred 
group  and  a  non-referred  comparison  group,  participated  in 
the  study.   All  dyads  met  the  following  criteria  to  be 
included  in  the  study:   1)  The  child  was  between  3.0  and  7.0 
years  old;  2)  English  was  the  primary  language  spoken  in  the 
home;  3)  The  mother  and  child  had  no  history  of  mental 
retardation;   4)  The  mother's  and  child's  language  skills 
were  sufficient  for  them  to  understand  each  other  and  for 
the  observers  to  understand  their  verbalizations  (e.g.,  the 
child's  language  skills  are  at  or  above  the  2  year  old  level 
as  measured  by  the  PPVT-R  or  another  standardized  measure  of 
verbal  ability) . 

The  30  mother-child  pairs  comprising  the  clinic- 
referred  group  had  been  referred  to  the  Child  Study 
Laboratory  at  the  University  of  Florida  Health  Sciences 
Center  for  the  children's  externalizing  behavior  problems. 
The  children  and  their  parents  were  assessed  in  the  Child 
Study  Laboratory  for  inclusion  in  a  treatment  outcome  study. 
Children  included  in  the  clinic-referred  group  had  met 
diagnostic  criteria  for  Oppositional  Defiant  Disorder  based 
on  their  parent's  responses  to  a  structured  interview 
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designed  to  yield  DSM-III-R  diagnoses.   Dyads  were  eligible 
for  inclusion  in  the  present  study  if  they  met  the  basic 
criteria  outlined  above,  and  the  child  received  a  Problem 
score  on  the  ECBI  of  greater  than  1 1 .   Parents  signed  a 
standard  consent  form  indicating  that  information  about 
their  family  would  be  used  for  research  purposes,  and  data 
used  in  this  study  was  routinely  collected  as  part  of  the 
standard  procedures  for  all  families  being  assessed  for 
inclusion  in  the  larger  treatment  outcome  study.   The  thirty 
families  representing  the  clinic-referred  group  in  the 
present  study  were  selected  randomly  from  the  larger  sample 
of  clinic-referred  children.   They  appear  to  be 
representative  of  the  characteristics  of  the  larger  sample. 
(See  Table  1 5  in  Appendix  A  for  comparison  of  demographic 
variables  between  current  sample  and  the  larger  sample  they 
were  drawn  from.) 

The  normal  comparison  group  consisted  of  30  mother- 
child  pairs  recruited  from  advertisements  placed  in 
recreation  areas,  libraries,  preschools,  and  day-care 
centers  in  the  Gainesville  area.   To  be  eligible  for  the 
study,  the  children  met  the  basic  inclusion  criteria  and 
also  received  a  Problem  score  on  the  Eyberg  Child  Behavior 
Inventory  of  1 1  or  less.   Additional  demographic  descriptors 
of  the  families  were  collected  to  describe  the  families, 
including  parent  level  of  education,  average  annual  income, 
and  single-  versus  two-parent  status  of  mothers. 
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The  normal  comparison  group  was  balanced  for  age,  sex, 
and  race  with  the  participants  in  the  clinic-referred  group. 
The  groups  were  not  significantly  different  on  these  sample 
characteristics.   The  children  in  the  clinic-referred  group 
ranged  in  age  from  3  years,  1  month  to  6  years,  11  months 
with  the  mean  age  being  4  years,  10  months  (SD  =  1  year,  1 
month).   The  children  in  the  comparison  group  ranged  in  age 
from  3  years,  1  month  to  6  years,  9  months  with  the  mean  age 
being  4  years,  9  months  (SD  =  1  year,  1  month).   The  clinic- 
referred  group  and  the  comparison  group  each  consisted  of  23 
males  and  7  females.   In  the  clinic-referred  group,  24 
children  were  Caucasian,  3  children  were  African  American,  2 
children  were  Hispanic,  and  1  child  was  of  Asian  descent  but 
was  being  raised  by  Caucasian  parents.   In  the  comparison 
group,  25  children  were  Caucasian,  3  children  were  African 
American,  and  2  children  were  Hispanic. 

A  summary  of  the  additional  measures  and  demographic 
information  collected  on  the  participant  families  is 
presented  in  Table  16.   The  parents'  SES  was  calculated 
using  Hollingshead' s  Four  Factor  Index,  which  yields  a  score 
based  on  parents'  education,  occupation,  sex,  and  marital 
status  (Hollingshead,  1975).   The  mean  SES  for  clinic- 
referred  families  was  38.3  (SD  =  12.4)  and  ranged  from  14  to 
61.   The  mean  SES  for  the  comparison  families  was  48.9  (SD  = 
10.8)  and  ranged  from  31  to  66.   The  clinic-referred  group's 
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Table  16 

Sample  Characteristics 

Variable 

Clinic-referred 

Comparison 

(n  =  30) 

(n  =  30) 

Sex  of  child  (%  male) 

77% 

77% 

Mean  child  age  (months) 

58.5 

57.1 

Family  composition  (%) 

Two-parent 

60.0 

86.0 

Single-parent 

40.0 

14.0 

Maternal  age  (years) 

30.7 

34.4 

Maternal  education3 

4.2 

5.6 

Maternal  employment  (%) 

Employed 

63.3 

66.7 

Not  employed 

36.7 

33.3 

Ethnicity  (%) 

Caucasian 

80.0 

82.0 

African  American 

10.0 

11.0 

Hispanic 

7.0 

7.0 

Other 

3.0 

0.0 

PPVT-R  standard  score 

M 

95.1 

102.1 

SD 

(14.3) 

(14.4) 

SES** 

M 

38.3 

48.9 

SD 

(12.4) 

(10.8) 

Hollingshead  SES  (n) 

Class  V 

1 

0 

Class  IV 

8 

0 

Class  III 

7 

6 

Class  II 

11 

14 

Class  I 

3 

10 

Note.    a  Maternal  education  was  assessed  on 

a  scale  of  1  to 

7^  1  =  less  than  7  years 

of 

education,  7  =  g: 

raduate  degree. 

p    <     .01 
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mean  falls  within  Hollingshead' s  (1975)  Class  III  SES 
category,  which  he  described  as  consisting  of  skilled 
craftsmen,  clerical,  sales  workers.   The  comparison  group's 
mean  falls  within  the  Class  II  category,  described  as  medium 
business,  minor  professional,  and  technical  workers.   The 
significant  difference  found  in  SES  between  the  groups  may 
be  related  to  the  markedly  higher  proportion  of  single 
parent  families  in  the  clinic-referred  group  (40%  versus  14% 
in  the  comparison  group).   Mothers  in  the  clinic-referred 
group  had  typically  graduated  from  high  school  while  mothers 
in  the  comparison  group  were  more  likely  to  have  received 
some  college  education. 

The  clinic-referred  and  comparison  groups  were  expected 
to  differ  significantly  on  the  measures  related  to  behavior 
problems  and  these  differences  were,  in  fact,  found.   The 
clinic-referred  group  demonstrated  significantly  elevated 
scores  on  all  measures  compared  to  the  non-referred  group. 
Mothers  in  the  clinic-referred  and  comparison  group  rated 
their  children  on  the  ECBI  as  having  mean  intensity  scores 
of  176.9  (SD  =  25.9)  and  103.8  (SD  =  23.3),  respectively. 
On  the  problem  score,  the  clinic-referred  children  were 
rated  as  having  a  mean  of  24.0  problem  behaviors  (SD  =  6.4) 
and  the  comparison  children  had  a  mean  of  4.2  problem 
behaviors  (SD  =  3.2).   It  is  important  to  note  that  the 
problem  score  was  used  to  select  the  participants,  and 
therefore,  differences  on  this  scale  are  anticipated. 
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On  the  PSI,  mothers  of  clinic-referred  children 
reported  a  mean  total  stress  score  of  293.7  (SD  =  34.7), 
which  falls  at  the  95th  percentile.   Mothers  of  children  in 
the  comparison  group  received  a  total  stress  score  of  216.1 
(SD  =  39.0),  which  falls  at  the  40th  percentile.   On  the 
PLOC,  mothers  of  clinic-referred  children  received  a  mean 
total  score  of  131.0  (SD  =  14.9).   Mothers  of  children  in 
the  comparison  group  received  a  mean  total  score  of  114.5 
(SD  =  12.9).   The  PLOC  scores  are  similar  to  scores  reported 
for  clinic  and  non-clinic  groups.   Roberts,  Joe,  and  Rowe- 
Hallbert  (1992)  reported  the  mean  test  score  for  a  non- 
clinic  group  was  108.2  (SD  =  16.8)  and  was  121.7  (SD  =  15.2) 
for  a  clinic-referred  sample. 

Table  17 

Scores  on  Measures  Used  to  Compare  Participants 


Measure  Clinic-referred  Comparison 

M        SD  M         SD 


176.9  (25.9)  103.8  (23.3) 

ECBI-P**;           24.0  (6.4)  4.2  (3.2) 

293.7  (34.7)  216.1  (39.0) 

146.1  (17.3)  98.2  (19.5) 

PSI  parent***     147.3  (22.3)  118.0  (22.9) 

PLOC***           131.0  (14.9)  114.5  (12.9) 


Note:   Scores  on  the  PLOC  for  the  comparison  group  are  based 
on  n  =  24.  All  other  analyses  are  based  on  n  =  30  for  the 
clinic-referred  group  and  the  comparison  group.   ***  p_  <   001 
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Measures 
The  Evberq  Child  Behavior  Inventory 

The  Eyberg  Child  Behavior  Inventory  (ECBI;  Eyberg,  in 
press)  consists  of  36  items  describing  typical  problem 
behaviors  for  children.   Parents  rate  the  frequency  with 
which  these  behaviors  occur  on  a  scale  of  1  (never  occurs) 
to  7  (always  occurs).   An  intensity  score,  ranging  from  36- 
252,  may  be  derived  by  summing  these  ratings.   A  problem 
score,  ranging  from  0-36,  is  derived  by  summing  the  number 
of  child  behaviors  deemed  problematic  by  the  parent. 

The  ECBI  was  recently  restandardized  with  798  children 
and  adolescents  aged  2  to  1 6  drawn  from  several  pediatric 
health  care  settings  (Colvin,  Eyberg,  &  Adams,  1996).   The 
participants  were  representative  of  the  demographic 
composition  of  the  Southeastern  United  States.   The  internal 
consistency  coefficient  for  the  ECBI  Intensity  score  was 
.94,  and  was  .93  for  the  Problem  score.   The  mean  Intensity 
scores  (n  =  221)  ranged  from  113.0  for  children  three  years 
old  to  88.0  for  children  six  years  old.   The  mean  Problem 
scores  (n  =  221)  ranged  from  8.1  for  children  three  years 
old  to  4.8  for  children  six  years  old.   The  ECBI  Intensity 
and  Problem  Scale  scores  were  not  significantly  correlated 
with  Hollingshead  SES  scores,  child  age,  or  ethnic  group. 
The  test-retest  reliability  coefficients  for  the  Intensity 
Scale  and  Problem  Scale  have  been  reported  as  r  =  .85  and  r 
=  .80,  respectively,  after  a  three  month  interval  and  r  = 
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.75  and  r  =  .75,  respectively,  after  a  ten  month  interval 
(Eyberg,  1992).   The  ECBI  has  demonstrated  external  validity 
by  differentiating  children  with  behavior  problems  from 
children  without  behavior  problems  (Eyberg  &  Ross,  1978)  and 
by  showing  pre-  to  post-treatment  changes  (Eyberg  & 
Robinson,  1982). 

Parenting  Stress  Index 

The  Parenting  Stress  Index  (Abidin,  1990),  an  101  item 
pencil  and  paper  measure  with  an  optional  Life  Stress  scale 
consisting  of  19  items,  was  originally  developed  as  a 
screening  measure  for  the  detection  of  stressors  within  a 
parent-child  system  commonly  associated  with  dysfunctional 
parenting.    The  items  of  the  PSI  are  divided  into  two 
domains,  the  Child  Domain  and  the  Parent  Domain,  each  of 
which  is  further  divided  into  subscales.   The  47  items 
comprising  the  Child  Domain  are  divided  into  6  subscales: 
Adaptability,  Acceptability,  Demandingness,  Child  Mood, 
Distractibillty,  and  Reinforces  Parent. 

The  Parent  Domain  has  7  subscales:  Parent  Depression 
Parent  Attachment,  Restrictiveness  of  Parental  Role, 
Parental  Sense  of  Competence,  Social  Isolation,  Relationship 
with  Spouse,  and  Parental  Health.   Finally,  the  optional 
Life  Stress  Domain  assesses  the  number  of  major  changes  in 
the  family's  environment,  such  as  death  in  the  family,  job 
changes,  moving,  etc. 
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Normative  information  on  the  PSI  has  been  gathered  on 
large  samples  of  parents  recruited  from  a  variety  of  public 
and  private  pediatric  clinics  in  the  United  States  (Abidin, 
1990).    Percentiles,  means  and  standard  deviations  are 
available  for  the  domain  scores  and  the  total  score  by  child 
age  (See  Table  14  for  age  groups  relevant  to  this  study). 

Table  1 4 

Normative  Data  for  the  Parenting  Stress  Index 


3  YEARS 
M     SD 


4  YEARS     5  YEARS      6  YEARS 
M     SD     M     SD      M     SD 


Total 

Stress     221    38      229    40    224    30     222    37 


Child 
Domain 


97 


Parent 

Domain    122    23 


103    19    101    16     99    20 
126    26    123    27     121    21 


From  Abidin,  1  990. 


Internal  reliability  coefficients  for  the  subscales  of 
the  PSI  have  been  determined  for  both  the  original 
standardization  sample  of  534  parents  who  obtained  services 
from  small  group  pediatric  clinics  in  central  Virginia  and 
from  a  cross-cultural  sample  of  435  parents  from  Bermuda  and 
the  United  States  (Hauenstein,  Scarr,  &  Abidin,  1986  as 
cited  in  Abidin,  1990).   The  internal  reliability 
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coefficients  from  both  of  these  samples  were  fairly 
consistent.   The  alpha  coefficients  for  both  samples  ranged 
from  .59  to  .78  for  the  Child  Domain  subscales  and  from  .55 
to  .80  for  the  Parent  Domain  subscales.   Based  on  the  sample 
of  534  parents,  the  internal  reliability  coefficients  for 
the  Child  Domain  Total  Scale  score  was  .89,  for  the  Parent 
Domain  Scale  Total  score  was  .93,  and  for  the  Total  stress 
score  was  .95. 

Test-retest  reliability  coefficients  have  been  computed 
for  intervals  ranging  from  three  weeks,  three  months,  and 
one  year.   Both  domain  scores  and  the  total  stress  score 
were  shown  to  have  adequate  test-retest  reliability 
coefficients. 

The  PSI  has  been  found  to  be  correlated  with  both  the 
Intensity  and  the  Problem  Scales  on  the  ECBI  (Eyberg,  Boggs, 
&  Rodriquez,  1992),  indicating  that  child  disruptive 
behaviors  are  associated  with  maternal  stress.   The 
correlation  between  the  ECBI  intensity  score  and  the  PSI 
total  score  was  .59,  .45  for  the  parent  domain  score,  and 
.59  for  the  child  domain  score.   The  correlation  between  the 
ECBI  problem  score  and  the  total  score  was  .60,  .45  for  the 
parent  domain  score,  and  .62  for  the  child  domain  score. 
Discriminant  validity  has  been  demonstrated  by  Mouton  and 
Tuma  (1988)  who  found  that  the  PSI  parent  and  child  domain 
scores  were  significantly  higher  for  clinic-referred  mothers 
compared  to  control  mothers. 
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The  Parental  Locus  of  Control  (PLOC) 

The  Parental  Locus  of  Control  Scale  (Campis,  Lyman,  & 
Prentice-Dunn,  1986)  consists  of  47  items  intended  to  assess 
parents'  attitudes  about  their  ability  to  influence  their 
children's  behavior.   The  test  items  are  rated  by  parents  on 
a  five-point  scale.   These  ratings  are  summed  to  yield  a 
total  score.   In  addition,  the  PLOC  is  divided  into  five 
subscales  labeled  Parental  Efficacy,  Parental 
Responsibility,  Child  Control  of  Parent's  Life,  Parental 
Belief  in  Fate/Chance,  and  Parental  Control  of  Child's 
Behavior.   The  PLOC  total  scale  score  was  reported  as  having 
high  internal  consistency  (Cronbach's  alpha  =  .92).   The 
Cronbach's  alpha  reliability  coefficients  for  the  subscales 
were  .75  for  Parental  Efficacy,  .77  for  Parental 
Responsibility,  .67  for  Child  Control,  .75  for  Fate/Chance, 
and  .65  for  Parental  Control  (Campis,  Lyman,  &  Prentice- 
Dunn,  1986). 

The  test-retest  reliability  coefficient  for  the  PLOC 
was  r  =  .829  after  a  mean  interval  of  16  days  (Roberts,  Joe, 
&  Rowe-Hallbert,  1992).   Campis,  Lyman,  &  Prentice-Dunn 
(1986)  found  that  parents  whose  children  had 
behavior/emotional  problems  had  significantly  higher  total 
scores  than  a  non-problem  sample,  indicating  that  they 
perceived  their  child's  behavior  as  less  under  their 
control.   Comparing  the  results  of  behavioral  observation 
with  the  PLOC,  the  total  score  was  found  to  be  negatively 
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associated  with  child  compliance  (r  =  -.349,  p  <  .01),  and 
positively  associated  with  negative  talk  (r  =  .346,  p  < 
.01),  cry/yell  (r  =  .276,  p  <  .05),  and  the  ECBI  intensity 
score  (r  =  .259,  p  <  .05)  (Roberts,  Joe,  &  Rowe-Hallbert, 
1992). 

Peabodv  Picture  Vocabulary  Test — Revised  (PPVT-R) 

The  PPVT-R  is  a  measure  of  receptive  or  hearing 
vocabulary  for  American  Standard  English  (Dunn  &  Dunn, 
1981).   The  PPVT-R  has  two  forms,  Form  L  and  M,  which  each 
contain  175  items.   The  measure  is  individually  administered 
to  participants  who  are  asked  to  select  verbally  or 
nonverbally  the  picture  which  best  represents  each  test  item 
verbally  presented  by  the  examiner.   The  PPVT-R  is  easily 
and  quickly  administered  because  only  those  items  between 
the  child's  basal  and  ceiling  level  are  administered.   The 
instrument  also  can  be  rapidly  scored.   The  raw  scores  then 
can  be  converted  to  standard  scores  with  a  mean  of  100  and 
standard  deviation  of  15. 

The  PPVT-R  was  standardized  on  4,200  children  between 
the  ages  of  2  1/2  and  18  years  old,  with  100  children  of 
each  sex  at  each  age  level.   The  sample  of  children 
approximated  the  1970  U.S.  census  data  for  sex,  age, 
geographic  location,  occupational  background,  racio-ethnic, 
and  urban-rural  population  distributions.   Internal 
consistency  coefficients  of  the  PPVT-R,  Form  L,  ranged  from 
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.67  to  .88,  based  on  split-half  reliability  procedures. 
Test-retest  reliability  coefficients  for  standard  scores 
ranged  from  .54  to  .90,  with  a  median  value  of  .77.   Test- 
retest  reliability  was  evaluated  on  a  subsample  of  962 
children  with  the  retest  interval  ranging  from  9  to  31  days. 
IQ  scores  and  PPVT-R  scores  have  been  found  to  be  correlated 
between  .40  and  .60.   However,  the  PPVT-R  scores  should  not 
be  interpreted  as  intelligence  scores. 

Procedures 

The  videotaping  and  administration  of  questionnaires  to 
both  groups  of  dyads  were  conducted  in  a  standardized  manner 
during  two  data  collection  sessions  held  one  week  apart. 
All  data  on  the  clinic-referred  sample  used  in  this  study 
were  collected  as  part  of  a  more  extensive,  standard 
assessment  conducted  for  a  treatment  outcome  study.   The 
clinic-referred  families  were  paid  $50  for  their 
participation  by  the  treatment  outcome  researchers.   The 
mothers  of  the  non-referred  children  were  recruited  through 
advertisements  placed  in  the  community.   After  completing 
all  of  the  data  collection,  the  mothers  were  paid  $20  for 
their  participation. 

A  total  of  forty-two  non-referred  mother-child  dyads 
completed  the  data  collection  process.   Twelve  dyads  were 
excluded  from  analysis  in  the  present  study  for  a  variety  of 
reasons.   The  predominant  reason  for  exclusion  of  subjects 
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was  to  create  a  non-referred  sample  that  matched  the 
demographic  characteristics  of  the  clinic-referred  sample. 
For  example,  too  many  female  subjects  and  three-year  olds 
were  initially  included  in  the  non-referred  group.   In 
addition,  three  children  were  excluded  from  the  non-referred 
group  because  of  high  maternal  ratings  on  the  ECBI  Problem 
Scale. 

To  maintain  confidentiality  of  the  dyads,  the 
videotapes  and  guestionnaires,  including  demographic 
information,  were  labeled  only  with  a  number  and  were  kept 
in  locked  files  which  were  accessible  only  to  the 
researchers.   Observers  did  not  have  access  to  demographic 
or  identifying  information  about  the  participant  families. 

For  videotaping  of  both  groups,  the  mother  and  child 
were  brought  to  a  playroom  in  the  Child  Study  Laboratory 
where  the  same  five  age-appropriate  toys  ,  selected  for 
their  unstructured,  interactive  quality,  were  provided. 
There,  the  dyad  was  videotaped  from  behind  a  one-way  mirror 
in  the  three  DPICS  II  standard  situations.   The  CDI  and  PDI 
situations  were  videotaped  for  10  minutes  and  CU  was 
videotaped  for  5  minutes.   Coding  was  completed  on  the  last 
five  minutes  of  CDI  and  PDI  and  the  five  minutes  of  CU. 

These  situations  were  first  described  to  the  parents 
before  taping.    During  the  observations,  the  parents  wore  a 


The  five  toys  used  in  the  assessment  are  Nesting  Animals, 
Lincoln  Logs,  Waffle  Blocks,  Magna  Doodles,  and  the  Sesame  Street 
Garage . 
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bug-in-the  ear  device,  an  audio  receiver  worn  in  the  ear 
similar  to  a  hearing  aid.   This  device  was  used  to  signal 
unobtrusively  to  the  mothers  when  CDI  began  and  when  to 
change  from  one  situation  to  another.   At  five  minute 
intervals,  the  parents  were  read  standard  instructions  over 
the  device  from  a  transmitter  in  the  observation  room. 

For  the  first  situation,  CDI,  the  following  directions 
were  given: 

"In  this  situation  tell  that  he/she 

may  play  with  whatever  he/she  chooses.   Let 
him/her  choose  any  activity  he/she  wishes.   You 
just  follow  his/her  lead  and  play  along  with 
him/her." 
After  the  5  minute  warm-up  period,  the  parent  was  told: 

"You're  doing  a  nice  job  of  allowing  

to  lead  the  play.   Please  continue  to  let  him/her 
lead." 
In  the  second  situation,  PDI,  the  following  instructions 
were  given: 

"That  was  fine.   Do  not  clean  up  the  play  things 
at  this  time.   Now  we'll  switch  to  another 

situation.  Tell  that  it  is  your  turn  to 

choose  the  game.   You  may  choose  any  activity. 
Keep  him/her  playing  with  you  according  to  your 
rules . " 
After  the  5  minute  PDI  warm-up  period,  the  parent  was  told: 
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"You're  doing  a  nice  job  of  leading  the  play. 

Please  continue  to  get  to  play  along 

with  you  according  to  your  rules." 

For  the  third  situation,  CU,  the  parent  was  given  the 

following  directions: 

"That  was  fine.   Now  I'd  like  you  to  tell 

that  it  is  time  to  leave  the  playroom 

and  the  toys  must  be  put  away .   Make  sure  you  have 
him/her  put  the  toys  away  by  him/herself.   Have 
him/her  put  all  the  toys  in  their  containers  and 
all  the  containers  in  the  toybox." 

Observers 

Four  graduate  students,  employed  as  DPICS  II  coders  in 
the  aforementioned  treatment  outcome  study,  served  as 
primary  coders  for  both  the  clinic-referred  group  and  the 
comparison  group.   These  coders  also  served  as  reliability 
coders  for  approximately  half  of  the  clinic-referred 
subjects. 

Before  beginning  to  code  videotapes  for  the  present 
study,  all  observers  had  successfully  completed  training 
procedures  for  the  DPICS  II  in  accordance  with  the 
recommendations  provided  by  The  Workbook:   A  coder  training 
manual  for  the  Dyadic  Parent-Child  Interaction  Coding  System 
II  (Eyberg,  Edwards,  Bessmer,  S  Litwins,  1994).   Training 
consisted  of  a  minimum  of  30  hours  of  didactic  training  in 
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DPICS  II  which  included  reading  the  coding  manual,  studying 
and  successfully  completing  paper  and  pencil  training 
exercises  and  quizzes,  and  coding  transcripts  of  actual 
parent-child  interactions.   The  observers  then  coded 
training  videotapes  with  a  transcript,  coded  videotapes  with 
feedback  from  a  trained  coder,  and  finally  coded  criterion 
tapes  to  evaluate  their  level  of  mastery.   The  coders  were 
considered  successfully  trained  when  they  achieved  a  minimum 
of  80%  agreement  with  "correct"  codings  of  a  criterion  tape 
on  selected  codes  specifically  related  to  the  hypotheses 
(e.g.,  parent  command,  child  compliance,  parent  critical). 
During  the  period  of  data  coding,  unannounced  checks  on 
reliability  were  conducted  intermittently  (the  first  author 
re-coded  tapes  at  random  intervals),  and  the  reliability 
estimates  were  shared  with  the  observers  in  order  to 
decrease  observer  drift.   Training  sessions  were  held  weekly 
with  the  observers  as  part  of  their  coding  responsibilities 
for  the  larger  treatment  outcome  study.   These  sessions  were 
used  to  discuss  any  ambiguities  found  in  the  coding  manual 
and  to  practice  coding  categories  that  were  considered 
difficult  or  had  poor  reliability. 

The  primary  observers  coded  three  videotaped  situations 
collected  from  each  of  the  two  observation  periods  for  a 
total  of  six  five-minute  segments  of  videotape.   Their 
observations  were  recorded  on  a  computer  software  package, 
Taee  (Eyberg  &  Celebi,  1993),  which  documents  the  sequence 
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in  which  behaviors  occurred,  as  well  as  the  time  they 
occurred.   To  ensure  optimal  reliability,  observers  prepared 
brief  written  logs  for  each  five-minute  situation  coded, 
noting  the  beginning  and  ending  time  of  each  segment  and 
noting  dif ficult-to-understand  verbalizations.   If  the 
primary  coder  understood  the  verbalization,  he  or  she  wrote 
down  the  words  with  no  punctuation  or  code.   However,  if  the 
verbalization  was  unintelligible,  the  observer  noted  this  on 
the  log  so  that  the  reliability  coder  would  not  attempt  to 
code  this  behavior.   The  logs  were  kept  in  order  to  aid  the 
reliability  coder  in:  a)  coding  the  same  segment  of  tape, 
using  the  same  starting  point  and  b)  coding  the  same  words 
as  the  primary  coder  whenever  possible. 

Videotapes  of  the  comparison  group  were  assigned  to  the 
observers  initially  by  a  faculty  supervisor  and  later  by  the 
author.   Although  the  observers  were  aware  that  they  would 
be  assigned  tapes  of  families  in  the  comparison  group,  they 
were  kept  blind  to  the  group  membership  of  the  dyads  on  the 
videotapes  and  to  the  hypotheses  of  the  present  study. 
Videotapes  of  dyads  in  the  comparison  group  were  stored  with 
the  videotapes  of  clinic-referred  children  and  were  labeled 
in  a  similar  manner.   Continued  attempts  were  made  to  keep 
the  observer's  uninformed  of  group  membership  throughout  the 
coding  process.   However,  for  approximately  50%  of  the 
tapes,  the  observers  were  aware  of  group  membership  when 
they  coded  tapes  for  payment  outside  of  their  assistantship 
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duties.   The  observers  did  remain  uninformed  as  to  the 
hypotheses  throughout  the  study. 

Reliability  was  assessed  on  50%  of  the  five-minute 
segments  for  each  family.   A  reliability  observer  re-coded 
three  of  the  six  segments  for  each  participant  family.   For 
the  clinic-referred  group,  reliability  coding  had  been 
partially  completed  by  observers  for  the  larger  treatment 
outcome  study.   The  author,  serving  as  an  additional 
reliability  coder  for  the  present  study,  re-coded  videotapes 
of  the  clinic-referred  families  as  necessary  so  that  50%  of 
the  segments  were  coded,  equally  distributed  across 
situations  (CDI,  PDI,  CU)  and  data  collection  sessions  (week 
1,  week  2).   Approximately  half  (42  out  of  90)  of  the 
segments  were  coded  by  the  author  for  reliability  on  the 
clinic-referred  group. 

To  assess  reliability  for  the  comparison  group,  the 
author  re-coded  50%  of  the  five-minute  segments  of  videotape 
for  each  dyad  in  the  comparison  group.   The  three  situations 
were  coded  for  each  family  equally  distributed  across  week  1 
and  week  2  data  collection  sessions. 


RESULTS 
Psychometric  Properties  of  Measures 
All  of  the  measures  used  to  evaluate  the  DPICS  II 
categories  for  validity  were  first  evaluated  for  internal 
consistency  within  the  present  samples.   Cronbach's  index  of 
internal  consistency  (Cronbach,  1951)  was  computed  for  the 
mothers'  responses  to  the  PS I,  the  PLOC,  and  the  ECBI 
Intensity  score  to  assure  measurement  reliability  for  the 
specific  populations  sampled.   The  internal  consistency 
estimates  for  the  clinic-referred  and  non-referred  groups 
combined  were  as  follows:   alpha  =  .95  for  the  PSI  total 
score,   alpha  =  .94  for  the  PSI  child  scale,   alpha  =  .93 
for  the  PSI  parent  scale,  alpha  =  .85  for  the  PLOC  total 
score,  and  alpha  =  .95  for  the  ECBI  intensity  score. 
Although  the  internal  consistency  estimate  for  the  PLOC  was 
somewhat  lower  than  previously  reported  estimates,  the 
internal  consistency  estimates  of  the  remaining  measures 
used  in  this  study  were  consistent  with  previous  published 
findings,  and  all  were  adequate  for  use  in  further  analyses. 

Reliability 
Percent  agreement  (average  and  weighted),  Cohen's  kappa 
(1960),  and  intraclass  correlations  (P)  were  computed  to 
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determine  the  reliability  of  the  parent  and  child 
categories.   Reliability  estimates  were  obtained  for  both 
groups  in  the  three  DPICS  situations  on  the  50%  of  the 
segments  observed  by  both  the  reliability  and  primary 
coders.   The  average  percent  agreement  and  kappa  were 
computed  using  a  computer  software  program  developed 
specifically  for  the  DPICS  II  (Eyberg  &  Celebi,  1993).   The 
average  percent  agreement  was  computed  using  a  five-second 
window,  which  considers  the  same  codes  from  the  two  raters 
that  are  within  five  seconds  of  each  other  as  agreements. 
Percent  agreement  was  based  on  occurrences  only  from  either 
the  primary  or  reliability  coder.    In  other  words,  only 
behaviors  that  were  coded  by  at  least  one  observer  were 
included  in  the  calculations.   In  this  real-time  coding 
system,  there  are  no  "empty"  intervals  (i.e.,  intervals  in 
which  there  is  no  occurrence  of  behavior  coded).   Weighted 
percent  agreement  was  calculated  by  dividing  the  sum  of 
agreements  across  the  subjects  by  the  sum  of  the  agreements 
plus  disagreements  across  subjects.   Kappa  estimates  were 
obtained  using  a  one-second  window  and  also  were  based  on 
occurrences  only  from  either  the  primary  or  reliability 
coder.   Intraclass  correlations  were  computed  by  a  formula 
derived  by  Fleiss  (1981)  which  is  based  on  analysis  of 
variance  procedures . 

Given  the  number  of  categories  in  the  coding  system, 
percent  agreement  above  70%  was  used  as  the  standard  for 
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acceptable  reliability  (Jones,  Reid,  &  Patterson,  1975). 
Fleiss  (1981)  indicated  that  kappa  values  greater  than  .75 
can  be  considered  as  representing  excellent  agreement  beyond 
chance.   Kappa  values  ranging  from  .60  to  .75  indicate  good 
agreement  beyond  chance,  values  from  .40  to  .60  indicate 
fair  agreement,  while  values  below  .40  are  considered  as 
indicative  of  poor  agreement.   These  kappa  values  will  be 
used  to  evaluate  the  kappas  found  in  this  study.   Intraclass 
correlations  can  be  evaluated  as  a  standard  correlation 
coefficient  (Suen  &  Ary,  1989). 

The  reliability  estimates,  weighted  and  average  percent 
agreement  and  kappa,  for  each  situation  for  each  of  the  two 
groups  are  presented  in  Tables  18  -  29  in  Appendix  A. 
(Intraclass  correlations  could  not  be  computed  for  each  of 
the  situations.   See  Table  30  in  Appendix  A  for  the 
intraclass  correlations  by  group.)   Listed  with  the 
reliability  estimates  in  the  tables  are:  (a)  the  total 
frequency  each  behavior  occurred  across  the  thirty  dyads  in 
each  group  as  observed  by  the  primary  coder;  and  (b)  the 
number  of  dyads  in  which  either  the  primary  and/or  the 
reliability  coder  observed  at  least  one  occurrence  of  the 
behavior.   These  numbers  are  included  to  provide  information 
about  the  occurrence  of  the  behaviors  to  aid  in  interpreting 
the  reliability  estimates. 

Tables  31  and  32  summarize  the  reliability  estimates 
for  the  parent  and  child  categories  combined  across  the 
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three  situations  and  across  groups.   The  reliability 
estimates  included  in  these  tables  are  weighted  and  average 
percent  agreement,  kappa,  and  intraclass  correlations. 

The  DPICS  II  categories  are  ranked  within  the  tables 
with  the  highest  estimates  appearing  first.   In  addition, 
borrowing  the  convention  used  to  rate  kappa  estimates 
created  by  Fleiss  (1981),  the  estimates  are  also  divided 
into  groups  considered  to  have  "excellent",  "good,"  and 
"fair"  reliability  estimates.   Given  the  variability  of  the 
estimates  across  types  of  reliability  for  each  category, 
this  classification  was  somewhat  subjective  and  was  often 
based  on  two  out  of  three  types  of  estimates. 

Several  categories  had  either  very  poor  estimates 
(e.g.,  Parent  Whine)  or  estimates  could  not  be  calculated 
because  of  insufficient  data.   For  example,  the  reliability 
of  the  parent  categories  of  Contingent  Praise,  Destructive, 
and  Yell  could  not  be  calculated  because  of  no  occurrence  of 
these  behaviors.   Similarly,  child  Labeled  Praise  could  not 
be  calculated,  and  child  Physical  Positive  and  Negative  had 
extremely  low  estimates. 

The  remaining  hypotheses  of  the  study  which  were 
related  to  the  validity  of  the  DPICS  II  involved  selected 
individual  categories  and  summary  variables,  comprised  of 
combinations  of  the  individual  categories.   In  order  to 
provide  kappa  reliablity  estimates  on  the  variables  used  in 
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Table  31 

Reliability  for  the  DPICS  II  Parent  Categories  Combined 
Across  Situation 


Parent  Category         Weighted    Average    Kappa    P 

%  Agree    %  Agree 


Excellent 

Information  Question 

85% 
(83%-88%) 

82% 

.80 

.93 

Direct  Command 

82% 
(80%-84%) 

77% 

.69 

.99 

Descriptive /Reflective 
Question 

80% 
(79%-82%) 

78% 

.74 

.90 

Unlabeled  Praise 

77% 
(72%-81%) 

76% 

.70 

.88 

Information  Description 

75% 
(73%-76%) 

74% 

.63 

.86 

Answer 

74% 
(70%-78%) 

71% 

.90 

.93 

Good 

Labeled  Praise 

71% 
(55%-88%) 

66% 

.68 

.89 

Laugh 

67% 
(62%-72%) 

64% 

.84 

.90 

Indirect  Command 

64% 
(61%-67%) 

57% 

.63 

.92 

Criticism 

63% 

(59%-67%) 

58% 

.62 

.94 

Acknowledgment 

58% 
(55%-61%) 

58% 

.59 

.86 

Playtalk 

69% 
(63%-75%) 

46% 

.76 

.85 
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Table  31  continued 


.46 

.75 

.55 

.69 

.57 

.81 

Parent  Category      Weighted      Average    Kappa        P 
%  Agree     %  Agree 

Good 

Compliance  54%  49%        .73       .79 

(45%-62%) 

No  Opportunity  for      53%         48%       .70       .82 
Compliance        (49%-57%) 

Fair 

Reflective  Statement    48%         45% 
(41%-55%) 

Behavioral  Description   43%         44% 
(31%-55%) 

Smart  Talk  47%         29% 

(35%-60%) 

No  Opportunity  for       44%         42%        .65       .78 
Answer  (35%-53%) 

Physical  Negative       39%         34%       .86       .82 
(27%-51%) 

Physical  Positive       37%         34%       .65       .49 
(27%-48%) 

Noncompliance  37%         34%       .63       .99 

(29%-44%) 

No  Answer  35%         34%       .54       .66 

(25%-44%) 

Whine  21%         19%       .66       .54 

(6%-35%) 

Insufficient  Data 

Contingent  Praise  **  **  **  ** 

Yell  **  **  **  .01 

Destructive  **  **  .00  .00 

Note.   Analyses  based  on  n  =  60,  combining  the  clinic- 
referred  group  (n  =  30)  with  the  comparison  group  (n  =  30). 
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Table  32 

Reliability  for  the  DPICS  II  Child  Categories  Combined 
Across  Situation 


Child  Category       Weighted      Average    Kappa 
%  Agree     %  Agree 


Excellent 

Information  Question    80%         79%       .87       .96 
(76%-83%) 


Information  Descript 

ion  78% 
(76%-80%) 

77% 

.71 

.93 

Answer 

73% 
(69%-78%) 

71% 

.82 

.82 

Good 

Descriptive/Reflective   68% 
Question           (63%-72%) 

65% 

.72 

.89 

Direct  Command 

68% 
(64%-72%) 

63% 

.72 

.89 

No  Opportunity  for 
Compliance 

67% 
(64%-70%) 

62% 

.59 

.95 

Laugh 

65% 
(58%-72%) 

53% 

.78 

.96 

Compliance 

63% 

(59%-67%) 

63% 

.71 

.92 

Acknowledgment 

64% 
(61%-67%) 

62% 

.74 

.79 

Playtalk 

60% 
(56%-64%) 

50% 

.70 

.95 

No  Opportunity  for 
Answer 

59% 
(54%-65%) 

57% 

.71 

.78 

Smart  Talk 

55% 
(49%-61%) 

47% 

.70 

.91 

64 


Table  32  continued 


Child 

Category 

Weighted 
%  Agree 

Average 
%  Agree 

Kappa 

P 

Good 

Yell 

52% 
(44%-60%) 

48% 

.57 

.93 

Whine 

50% 
(44%-56%) 

39% 

.57 

.85 

Unlabeled 

Praise 

50% 
(29%-71%) 

54% 

.72 

.81 

Noncompl iance 

48% 
(44%-53%) 

40% 

.55 

.85 

Indirect 

Command 

45% 
(38%-51%) 

42% 

.61 

.74 

Fair 
Criticism 


45% 
(39%-52%) 


Reflective  Statement    45% 

(33%-57%) 


49% 


39% 


.58 


.51 


.60 
.66 


Destructive 

41% 
(34%-48%) 

39% 

.49 

.79 

No  Answer 

37% 
(30%-45%) 

36% 

.51 

.64 

Behavioral  Description   32% 

(7%-57%) 

43% 

.43 

.63 

Physical  Negative 

18% 
(4%-32%) 

19% 

.33 

.29 

Physical  Positive 
Insufficient  Data 

17% 
(5%-28%) 

17% 

.61 

.37 

Labeled  Praise 

** 

** 

** 

-.34 

Note.   Analyses  based 

on  n  =  60, 

combinin< 

j  the  clinic- 

referred  group  (n  =  30)  with  the  comparison  group  (n  =  30). 
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further  analyses,  summary  variables  were  created  by  dividing 
the  categories  of  interest  into  naturally  occurring  classes 
of  behaviors  (e.g.,  verbalizations,  vocalizations,  and 
motoric  behaviors)  (See  Table  33).    Three  summary  variables 
described  child  and  parent  inappropriate  behavior:   Negative 
Talk  (Critical  +  Smart  Talk),  Negative  Vocalizations  (Whine 
+  Yell),  and  Negative  Behavior  (Physical  Negative  + 
Destructive).   The  parent  summary  variable  of  Negative 
Vocalizations  was  dropped  due  to  low  reliability  estimates. 
Finally,  the  summary  variable  of  Prosocial  Behavior  was 
developed  for  parent  and  child.   The  parent  Prosocial 
category  contained  verbalizations  (Acknowledgment, 
Behavioral  Description,  Information  Description,  Labeled 
Praise,  Unlabeled  Praise,  and  Reflection)  and  the  categories 
of  Laugh,  Physical  Positive,  and  Answer.   The  child 
Prosocial  Behavior  summary  variable  contained  the  same 
categories  except  Physical  Positive  was  dropped  because  of 
its  low  reliability  estimate.    The  variable  child 
Noncompliance  was  considerably  less  reliable  than  child 
Compliance.   Conseguently ,  Compliance  was  used  to  test  the 
hypotheses  regarding  validity.   Although  the  kappa  estimate 
for  child  Negative  Behavior  was  somewhat  low,  all  of  the 
variables  demonstrated  adeguate  kappa  reliability  and  were 
considered  acceptable  to  be  used  in  subseguent  analyses. 


Table  33 

Kappa  Estimates  for  DPICS  II  Summary  and  Individual 
Variables  Combined  Across  Situations 
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Variable 


Clinic 
(n=30) 


Comparison 
(n=30) 


Total 
(n=60) 


PARENT  BEHAVIOR 


Prosocial3 
Answer 
Laugh 
Physical  Positive 

.64 
.92 
.85 
.46 

Negative  Talk 

.84 

Negative  Behavior 

.67 

Total  Command 

.70 

Direct  Command  Ratio 

.67 

CHILD  BEHAVIOR 

Prosocial3 
Answer 
Laugh 

.67 
.85 
.77 

Compliance  Ratioc  .72 

Negative  Talk  .71 

Negative  Vocalization  .51 

Negative  Behavior  .51 
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.65 

88 

.90 

82 

.90 

78 

.49 

56 

.60 

57 

.80 

70 

.70 

67 

.69 

71 

.69 

77 

.82 

77 

.96 

69 

.71 

64 

.69 

75 

.79 

53 

.52 

Note:   a  Kappa  estimate  for  verbalization  categories 
combined  (Acknowledgment  +  Descriptions  +  Praise  + 
Reflection).   b  Kappa  estimate  for  Direct  Command  category. 
c  Kappa  estimate  for  Compliance  category. 


With  the  exception  of  the  prosocial  behavior 
categories,  the  summary  variables  were  found  to  be  non- 
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normally  distributed,  primarily  due  to  the  low  or 
nonexistent  occurrence  of  some  of  the  inappropriate  behavior 
categories.   The  distributions  of  the  variables  measuring 
inappropriate  behavior  were  skewed  toward  zero,  particularly 
for  the  comparison  group.   To  address  this  problem,  the 
variables  first  were  combined  into  broader  or  composite 
summary  variables  to  provide  a  wider  range  of  possible 
values.   These  values  were  then  transformed  using 
mathematical  functions  described  below. 

The  composite  summary  variable  of  child  Inappropriate 
Behavior  was  created  from  the  sum  of  Negative  Talk,  Negative 
Behavior,  and  Negative  Vocalization  (i.e.,  Critical  +  Smart 
Talk  +  Destructive  +  Physical  Negative  +  Whine  +  Yell). 
The  composite  summary  variable  for  parent  Inappropriate 
Behavior  was  comprised  of  Negative  Talk  and  Negative 
Behavior  (i.e.,  Critical  +  Smart  Talk  +  Destructive  + 
Physical  Negative).    Unlike  the  child  summary  variable, 
parent  Inappropriate  Behavior  did  not  include  parent 
Negative  Vocalizations  because  no  estimate  could  be 
calculated  for  Yell,  and  Whine  had  an  extremely  low 
reliability  estimate. 

In  addition,  the  summary  variables  were  transformed 
prior  to  analysis.   Arc  sine  transformations  of  the  square 
root  of  the  value  were  completed  on  the  child  compliance 
ratio  and  parent  direct  command  ratios  while  the  other 
variables  were  transformed  by  adding  .1  to  their  value  and 
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then  taking  their  square  root  (Personal  communication,  John 
Hartzel,  September,  1995).   Analyses  were  performed  both 
with  transformed  and  untransformed  values  for  the  summary 
variables.   The  results  of  the  analyses  for  the 
untransformed  variables  may  be  more  easily  translated  into 
clinically  useful  information  than  results  based  on 
transformed  variables. 

Validity 
Discriminant  validity 

Previous  behavioral  observation  systems  have  found  that 
specific  behaviors  differentiate  children  with  behavior 
problems  from  non-referred  children.   Analyses  were 
conducted  on  the  DPICS  II  variables  to  evaluate  the 
discriminant  validity  of  the  system.   Because  of  the 
significant  difference  in  SES  between  the  two  groups,  SES 
was  used  as  a  covariate  in  the  analyses.   In  order  to 
control  for  Type  I  error  and  SES  effects,  a  multivariate 
analysis  of  covariance  (MANCOVA)  was  used  to  test 
differences  between  groups  on  child  Compliance  Ratio 
(Compliance/Total  Commands),  child  Inappropriate  Behavior 
(Negative  Talk  +  Negative  Vocalizations  +  Negative 
Behavior),  child  Prosocial  Behavior  (Acknowledgment  + 
Behavioral  Descriptions  +  Information  Descriptions  +  Labeled 
Praise  +  Unlabeled  Praise  +  Reflection  +  Laugh  +  Answer), 
Total  number  of  parental  commands  (Direct  +  Indirect 
Commands),  parent  Direct  Command  Ratio  (Direct 


69 

Commands/Total  Commands),  parent  Prosocial  Behavior,  and 
parent  Inappropriate  Behavior  (Negative  Talk  +  Negative 
Behavior) . 

When  all  seven  transformed  variables  were  entered 
together  in  the  MANCOVA,  controlling  for  the  variable  SES, 
the  effect  of  group  membership  was  statistically 
significant,  Hotelling's  T2  (7,51)  =  7.91,  p  <  .001. 
Similarly,  when  the  untransformed  values  of  the  seven 
variables  were  entered  in  to  the  MANCOVA,  the  effect  of 
group  membership  was  again  found  to  be  significant, 
Hotelling's  T2  (7,51)  =  6.39,  p  <  .001.   Further  analyses  of 
the  individual  summary  variables  were  conducted  to  explore 
which  variables  contributed  to  the  overall  difference  found 
between  the  two  groups  (See  Table  34). 

The  differences  between  groups  were  examined  for  each 
summary  variable  using  Analysis  of  Covariance  (ANCOVA) 
procedures  to  control  for  SES  effects.   Using  the 
untransformed  values  of  the  variables,  the  results  revealed 
that  the  two  groups  differed  significantly  on  all  of  the 
summary  variables  except  for  child  Prosocial  Behavior. 
Table  34  also  includes  the  mean  frequency  of  occurrence  of 
the  behavioral  categories  (untransformed  values).   The  means 
reported  here  represent  the  frequency  of  occurrence  summed 
across  the  three  situations.   See  Table  35  in  Appendix  A  for 
the  results  of  univariate  analyses  on  the  transformed  values 
of  the  variables. 
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Table  34 

Summary  of  Univariate  Analysis  of  Covariance  for 
Untrans formed  Summary  Variables  Comparing  the  Clinic- 
referred  and  Comparison  Group 


Mean 
Variable  Clinic   Comparison       F(1/57) 

Parent  Categories 
Prosocial  Behavior 
Direct  Command  Ratio 
Total  Commands 
Inappropriate  Behavior 

Negative  Talk 

Negative  Behavior 
Child  Categories 
Prosocial  Behavior 
Compliance  ratio 

Inappropriate  Behavior 

Negative  Talk 

Negative  Vocalization 

Negative  Behavior 

Note .   Means  based  on  n  =  30  for  each  group.   Values  based 
on  the  mean  freguency  of  occurrence  summed  across  the  three 
DPICS  II  situations. 
*  p  <  .05.   **  E  <  .01.   ***  E  <  -001. 


A  discriminant  function  analysis  also  was  performed  on 
the  summary  variables  to  demonstrate  that  DPICS  II  variables 
could  be  used  to  distinguish  between  the  clinic  and  non- 
clinic  samples.   The  technigue  known  as  " jackknif ing"  was 
used  to  more  accurately  identify  the  classification  rate 


92.53 

121  .37 

8.11 

.72 

.57 

12.71** 

62.58 

39.67 

9.78** 

20.37 

5.40 

20.59*** 

18.35 

8.30 

15.13*** 

2.35 

.42 

8.73** 

89.98 

88.5 

.49 

.53 

.75 

19.17*** 

31  .28 

10.02 

14.96*** 

14.45 

5.10 

10.36** 

12.77 

3.17 

15.13*** 

4.07 

1  .75 

6.39* 
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(Norusis,  1993).   Using  this  technique,  each  case  is,  in 
turn,  excluded  from  the  calculation  of  the  discriminant 
function,  and  later  entered  into  the  function  to  determine 
if  it  can  be  correctly  classified.    This  method  is  thought 
to  produce  a  more  accurate  estimate  of  the  function's 
classification  rate  because  the  case  was  not  used  to  create 
the  function  (Norusis,  1993). 

SES  along  with  the  transformed  variables  of  child 
Compliance,  child  Prosocial,  child  Inappropriate  Behavior, 
parent  Total  Command,  parent  Prosocial  Behavior,  parent 
Direct  Command  Ratio,  and  parent  Inappropriate  Behavior  were 
used  in  the  jacknifing  procedure,  yielding  an  overall 
correct  classification  rate  of  86.6%.   Twenty-six  of  the 
thirty  dyads  were  correctly  classified  in  each  group,   when 
the  same  analysis  was  performed  using  SES  and  untransformed 
values  for  the  DPICS  II  summary  variables,  the  overall 
classification  rate  was  the  same  (86.6%);  however,  twenty- 
five  non-referred  dyads  and  twenty-seven  referred  dyads  were 
correctly  classified. 

When  all  of  the  subjects  were  entered  simultaneously 
into  a  discriminant  analysis,  the  classification  rate  was 
slightly  higher  at  93.3%  for  transformed  values  and  90%  for 
untransformed  values  of  the  variables.   (See  Table  36  in 
Appendix  A  for  the  classification  function  coefficients  for 
the  untransformed  variables.) 
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When  the  variable  of  SES  was  eliminated  from  the 
analyses  to  determine  how  well  the  DPICS  II  categories  alone 
could  classify  the  participants,  the  transformed  variables 
yielded  a  classification  rate  of  86.6%  using  the  jacknifing 
procedure  and  90%  when  all  participants  were  entered 
simultaneously.   The  untransformed  variables  without  the 
inclusion  of  SES  in  the  analysis  yielded  a  classification 
rate  of  81.7%  using  the  jacknifing  procedure  and  86.6%  when 
all  the  participants  were  used  in  the  analysis. 

To  determine  whether  a  smaller  group  of  variables 
could  effectively  discriminate  between  participants,  the 
transformed  and  untransformed  variables  and  SES  were  entered 
into  a  stepwise  discriminant  analysis.    Using  only  the 
transformed  variables  of  child  Inappropriate  Behavior, 
parent  Prosocial  Behavior,  and  parent  Inappropriate 
Behavior,  the  classification  rate  was  90%  for  both  the 
jacknifing  procedure  and  the  regular  discriminant  analysis. 

When  the  stepwise  discriminant  analysis  was  performed 
on  the  untransformed  values  and  SES,  the  variables  of  parent 
Inappropriate  Behavior,  child  Compliance  Ratio,  parent 
Prosocial  Behavior,  and  SES  yielded  a  correct  classification 
rate  of  91.6%  for  the  jacknifing  procedure  and  of  95%  for 
the  regular  discriminant  analysis  (see  Table  37  in  Appendix 
A).   The  classification  function  coefficients  used  to 
calculate  the  group  membership  of  a  particular  subject  using 
these  four  variables  are  listed  in  Table  38  in  the  appendix. 
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In  summary  of  the  analyses  completed,  the  MANCOVA 
revealed  significant  differences  between  groups  using  the 
transformed  and  untransformed  values  of  the  DPICS  II 
variables.   The  post-hoc  univariate  analyses  of  these 
variables  also  demonstrated  significant  differences  between 
groups  using  the  transformed  and  untransformed  values.   In 
addition,  the  transformed  and  untransformed  variables  were 
able  to  successfully  discriminate  between  the  two  groups  of 
clinic-referred  and  comparison  participants  during  the 
discriminant  analysis.   In  order  to  provide  the  most 
clinically  relevant  information,  the  remaining  analyses  will 
focus  on  the  untransformed  values.   The  results  of  the 
transformed  values  of  the  variables  will  also  be  reported, 
primarily  in  the  appendix. 
Convergent  validity 

Next,  the  DPICS  II  variables  were  used  to  predict  the 
scores  on  various  measures  associated  with  children  with 
behavior  problems.   In  the  first  analysis,  the  DPICS  II 
variables  were  used  to  predict  the  ECBI  Intensity  score. 
Table  39  provides  a  matrix  of  partial  correlations  for  the 
untransformed  variables  used  to  predict  the  ECBI  Intensity 
score  controlling  for  SES  (See  Table  40  in  the  appendix  for 
the  Spearman  correlation  matrix  of  the  transformed  values). 

Table  39  reveals  highly  significant  correlations 
between  variables.   The  ECBI  Intensity  score  was 
significantly  correlated  with  all  DPICS  II  variables  with 
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the  exception  of  child  Prosocial.   The  DPICS  II  summary 
variables  also  were  significantly  intercorrelated.   Child 
Compliance,  for  example,  was  negatively  correlated  with 
parent  Inappropriate  Behavior.   Child  Inappropriate  Behavior 
was  highly  positively  correlated  with  Parent  Inappropriate 
Behavior  and  Total  Commands  and  negatively  correlated  with 
Compliance.   Parent  Direct  Command  Ratio  was  negatively 
correlated  with  both  parent  Prosocial  Behavior  positively 

Table  39 

Partial  Correlations  Between  DPICS  II  Variables  and  ECBI 
Intensity  Score  Controlling  for  SES 


Variable 


1.  ECBI-I  -.02   .30*  -.41**   .45** 
CHILD  BEHAVIOR 

2.  Prosocial   .05  -.05    -.18 

3.  Inappropriate    -.72***  .19 

4.  Compliance  Ratio        -.16 
PARENT  BEHAVIOR 

5.  Direct  Command  Ratio 

6.  Prosocial 

7.  Inappropriate 

8.  Total  Commands 


.35** 


.  40** 


.30* 


.08 

-.18 

.02 

.09 

.45** 

46*** 

.02 

-.33* 

25 

-.  41  ** 


.40** 
-.14 


28* 

03 
72 


Note.  All  analyses  based  on  N  =  60. 
*E  <  .05.   **p_  <  .01.   ***E  <  .001. 
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correlated  with  Inappropriate  Behavior.   Although  these  high 
correlations  are  reasonable  and  expected,  they  can  affect 
the  outcome  of  the  multiple  regression  as  each  variable  does 
not  contribute  unique  effects. 

Hierarchical  multiple  regression  analyses  were  used  to 
determine  the  relative  contributions  of  SES,  child  Prosocial 
Behavior,  child  Inappropriate  Behavior,  parent  Inappropriate 
Behavior,  parent  Direct  Command  Ratio,  parent  Prosocial 
Behavior,  and  parent  Total  Command  in  the  prediction  of  the 
ECBI  Intensity  score.    The  untransformed  variables 
accounted  for  40%  of  the  variance  in  the  ECBI  Intensity 
Score,  F(8,51)  =  4.17,  p  <  001.   As  shown  in  Table  41,  after 
considering  the  effect  of  SES,  child  Compliance  accounted 
for  13%  of  the  variance,  parent  Inappropriate  Behavior 
accounted  for  7%  of  the  variance,  and  parent  Direct  Command 
Ratio  accounted  for  6%  of  the  variance.    The  other 
variables  entered  into  the  analysis  contributed  little 
additional  predictive  power. 

When  all  of  the  transformed  summary  variables  were 
included  in  the  analysis,  they  were  found  to  account  for  a 
significant  proportion  of  variance  (45%)  in  the  ECBI 
Intensity  Score,  F(8,51)  =  5.24,  p  <  .001  (See  Table  42  in 
Appendix  A).   SES  and  Parent  Inappropriate  Behavior 
accounted  for  12%  and  27%  of  the  variance  respectively.   The 
other  variables  were  not  found  to  contribute  signficantly  to 
the  prediction  of  the  ECBI  Intensity  score. 
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Table  41 

Summary  of  Hierarchical  Multiple  Regression  Analysis  for 
Untransformed  Variables  Predicting  ECBI  Intensity  Score 


Predictor  Variable  R       R2 


R^  change   F  change 


SES 

Compliance 

Parent  Inappropriate 

Direct  Command  Ratio 

Parent  Prosocial  Behavior 

Child  Prosocial  Behavior 

Total  Command 

Child  Inappropriate 


-.14 

.11 

7.88** 

-.26 

.13 

8.63** 

.24 

.07 

4.24** 

.23 

.06 

3.35* 

-.12 

.01 

.64 

.07 

.003 

.18 

-.04 

.001 

.05 

-.04 

.0005 

.03 

Note,,  p  coefficients  are  given  for  equation  when  all 

variables  entered. 

*  p  <  .05.   **  p_  <  .01  . 


In  the  fifth  hypothesis,  it  was  proposed  that  DPICS  II 
variables  of  child  Compliance,  child  Prosocial,  and  Child 
Inappropriate  Behavior  would  predict  the  child  domain  score 
on  the  PSI.   Table  43  presents  the  partial  correlation 
matrix  for  untransformed  variables  to  be  included  in  this 
analysis,  controlling  for  the  effects  of  SES.   Child 
Compliance  was  negatively  correlated  with  child 
Inappropriate  Behavior,  (r(60)  =  -.72,  p_  <  .001).   (See 
Table  44  in  the  appendix  for  the  Spearman  correlation  matrix 
with  transformed  variables). 
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Table  43 


Partial 

Correlation  Matrix  for 

Child 

Variables 

Used 

to 

Predict 

the 

Child 

Domain 

Score 

on 

the  PSI 

Variable 

1 

2        3 

1.  Compliance  Ratio  -.05    -.72*** 

2.  Prosocial  —  .05 

3.  Inappropriate  Behavior   —       —       — 

*  p_  <  .05.  ***  e  <  .001  . 

In  a  hierarchical  multiple  regression  analysis,  these 
child  summary  variables  were  used  as  predictor  variables  of 
the  scores  on  the  child  domain  of  the  PSI.   Together,  the 
untransformed  variables  accounted  for  22%  of  the  variance, 
F(4,55)  =  3.96,  p_  <  .01.   As  shown  in  Table  45,  SES 

Table  45 

Summary  of  Hierarchical  Multiple  Regression  Analysis  for 
Untransformed  Variables  Predicting  PSI  Child  Domain  Scores 

Predictor  Variable              P  R2  change  F  change 

SES  -.33         .13  8.92** 

Child  Inappropriate  Behavior    .09         .06  3.77* 

Child  Compliance  -.23        .03  1.45 

Child  Prosocial  Behavior  -.05        .003  .15 


Note.   p  coefficients  are  given  for  equation  when  all 
variables  entered. 
*  p.  <  .05  **  e  <  .01  . 
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accounted  for  approximately  13%  of  the  variance  in  the  child 
domain  score  and  the  untransformed  variable  of  child 
Inappropriate  Behavior  accounted  for  an  additional  6%.   In 
the  same  analysis,  the  transformed  variables  were  found  to 
account  for  significant  variance  (25%)  in  the  PSI  child 
domain  score,  F(4,55)  =  4.55,  p_  <  .01  (See  Table  46  in  the 
appendix) . 

The  sixth  hypothesis  of  the  study  proposed  that  the 
DPICS  II  summary  variables  of  parent  Inappropriate  Behavior, 
parent  Prosocial  Behavior,  parent  Total  Command,  and  parent 
Direct  Command  Ratio  would  account  for  significant  variance 
in  the  parent  domain  score  of  the  PSI.   Table  47  presents 
the  partial  correlation  matrix  for  the  untransformed 
variables  used  to  predict  the  parent  domain  score  of  the  PSI 
(See  Table  48  in  the  appendix  for  the  Spearman  correlations 
for  the  transformed  variables). 

Table  47 


Partial  Correlation  Matrix  for  Parent  Variables 

Used  to 

Predict  the  Parent  Domain  Score  on  the  PSI 

Variable                    1      2      3 

4 

1.  Direct  Command  Ratio  .28*  .40**  -.41** 

2.  Total  Commands           —  .72***  -.03 

3.  Inappropriate  Behavior   —  —  -.14 

4.  Prosocial  Behavior      —  —  — 

*  p.  <  .05.   **  p_  <  .01.   ***  p_  <  .001. 
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Parent  Direct  Command  Ratio  was  significantly  correlated, 
controlling  for  SES,  with  parent  Total  Commands,  parent 
Inappropriate  Behavior,  and  parent  Prosocial  Behavior.   In 
addition,  parent  Total  Commands  was  signficantly  correlated 
with  parent  Inappropriate  Behavior  (  r(60)  =  .72,  p_  <.001). 

When  the  parent  categories  of  Direct  Command  Ratio, 
Prosocial  Behavior,  Total  Commands,  and  Inappropriate 
Behavior  (Critical  +  Smart  Talk  +  Physical  Negative  + 
Destructive)  were  used  as  predictors  of  the  PSI  parent 
domain  score  in  a  hierarchical  multiple  regression  analysis, 
the  untransformed  variables  did  not  account  for  a 
significant  proportion  of  variance  (13%)  in  the  parent 
domain  score,  £(5,54)  =  1.66,  E  =  .16.   In  this  analysis, 
SES  accounted  for  6%  (E  <  .05)  of  the  variance  and  parent 
Inappropriate  Behavior  accounted  for  an  additional  6%  (p_  < 
.05)  of  the  variance  in  the  scores.   The  other  variables  in 
the  eguation  did  not  contribute  significantly  to  the 
prediction  of  the  PSI  parent  domain  score.   These  results 
are  summarized  in  Table  49. 

In  the  same  analysis,  the  transformed  variables 
accounted  for  19%  of  the  variance  in  the  parent  domain 
score,  F(5,54)  =  2.53,  E  <  .05.   The  variables  of  SES  and 
parent  Inappropriate  Behavior  accounted  for  6%  (p_  <  .05)  and 
12%  (E  <  .01)  of  the  variance,  respectively.  (See  Table  50 
in  the  appendix  for  a  summary . ) 
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Table  49 

Summary  of  Hierarchical  Multiple  Regression  Analysis  for 
Untransformed  Variables  Predicting  PSI  Parent  Domain 


Predictor  Variable  P       r2  change   F  change 


SES 

-.16 

.06 

4.00* 

Inappropriate  Behavior 

.27 

.06 

3.53* 

Direct  Command  Ratio 

.11 

.007 

.41 

Total  Commands 

-.08 

.003 

.15 

Prosocial  Behavior 

.03 

.0005 

.03 

Note.   P  coefficients  are 

given  for  equ 

ation  when 

all 

variables  entered. 
*  E  <  .05. 


The  sixth  hypothesis  also  proposed  that  the  parent 
variables  of  parent  Direct  Command  Ratio,  Total  Commands, 
and  parent  Inappropriate  Behavior  would  account  for 
significant  variance  in  the  total  score  on  the  Parenting 
Locus  of  Control  (PLOC)  scale.   Table  51  presents  the 
partial  correlation  matrix,  controlling  for  SES,  for  the 
untransformed  variables  used  in  the  analysis  and  post-hoc 
analyses.   (See  Table  52  in  the  appendix  for  the  Spearman 
correlation  matrix  for  the  transformed  variables  used  in  the 
analysis  and  in  post-hoc  analyses.)   As  shown  in  previous 
correlation  matrices,  there  are  several  significant 
intercorrelations  between  the  predictor  variables.  Child 
Inappropriate  Behavior  is  positively  correlated  with  Parent 
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Innapropriate  Behavior  r(60)  =  .45,  p  <  .001  and  negatively 
correlated  with  Compliance  r(60)  =  -.72,  p  < . 001 . 

Table  51 

Correlation  Matrix  for  Variables  Predicting  the  PLOC  Score 

Variable  2     3      4        5        6     7 

1.  Total  Commands   .28*   .72***   .46***  -.25    -.03    .02 

2.  Direct  Command        .40**   .19     -.16    -.41**  -.18 

Ratio 

3.  Parent  .45***  -.33*   -.14   -.18 

Inappropriate 

4.  Child  -.72***  .09     .05 

Inappropriate 

5.  Compliance  -.02   -.05 

6.  Parent  Prosocial  .08 

7.  Child  Prosocial 

*  s.   <  -05.   **  p  <  .01.   ***  p  <  .001. 

SES  and  the  transformed  parent  variables  of  parent 
Prosocial,  Total  Commands,  Direct  Command  Ratio,  and  parent 
Inappropriate  Behavior  were  entered  into  a  hierarchical 
multiple  regression  analysis  as  predictor  variables  for  the 
total  score  of  the  PLOC.   Together,  these  variables 
accounted  for  a  significant  proportion  of  variance  (27%), 
F(5,50)  =  3.67,  p  <  .01.   SES  and  parent  Inappropriate 
Behavior  each  accounted  for  approximately  1 0%  of  the 
variance  in  the  PLOC  score.   The  same  analysis  completed 
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using  the  untransformed  values  of  the  variables  resulted  in 
22%  of  the  variance  being  accounted  for,  F(5,50)  =  2.82,  p_  < 
.05.   Table  51  presents  the  results  of  this  analysis. 

Table  51 

Summary  of  Hierarchical  Multiple  Regression  Analysis  for 
Untransformed  Variables  Predicting  PLOC  Total  Score 


Predictor  Variable  p       R2  change   F  change 


SES 

Parent  Prosocial 

Parent  Inappropriate 

Parent  Total  Commands 

Parent  Direct  Command  Ratio 

Child  Prosocial 

Child  Inappropriate 

Child  Compliance 

Note .   P  coefficients  are  given  for  equation  when  all 

variables  entered. 

*  p_  <  .05.   **  p_  <  .01 . 

Three  additional  variables  were  examined  in  a  multiple 
regression  analysis  of  predictors  of  the  PLOC  total  score  as 
part  of  post-hoc  analyses.   Because  the  PLOC  score  is 
thought  to  reflect  the  parents'  perceptions  of  successfully 
managing  their  child's  behavior,  the  variables  of  child 
Prosocial,  child  Compliance,  and  child  Inappropriate 


-.22 

.10 

5.91* 

-.32 

.06 

3.53* 

-.13 

.04 

2.16 

.23 

.01 

.77 

-.05 

.01 

.60 

-.06 

.00002 

.0001 

-.17 

.05 

2.70* 

-.58 

.16 

9.45*** 
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Behavior  were  entered  into  a  hierarchical  multiple 
regression.   When  these  variables  were  included  in  the 
regression,  the  proportion  of  variance  accounted  for  by  the 
variables  increased  from  22%  to  42%  F(8,47)  =  4.36,  p.  < 
.001.   This  increase  was  due  largely  to  the  effect  of  the 
child  Compliance  variable.   The  results  are  summarized  in 
Table  53. 


DISCUSSION 
The  results  of  the  study  supported  the  hypotheses  that 
the  DPICS  II  coding  system  is  reliable  and  valid  for  use  in 
assessing  children  with  behavior  problems.    First,  with 
some  exceptions,  the  categories  of  the  DPICS  II  demonstrated 
adequate  reliability.   Second,  discriminant  validity  of  the 
DPICS  II  categories  was  demonstrated.   Finally,  evidence  of 
the  convergent  validity  of  the  DPICS  II  was  provided  when 
summary  variables  were  shown  to  account  for  significant 
proportions  of  variance  in  various  other  measures  thought  to 
be  associated  with  behavior  problems  in  children. 

Reliability 

A  variety  of  reliability  estimates  were  examined  for 
these  data.   All  of  the  parent  and  child  DPICS  II  categories 
were  ranked  and  then  subdivided  into  groupings  labeled 
"excellent",  "good",   "fair,"  and  "insufficient  data"  to 
provide  a  method  of  organizing  the  information.   Subjective 
judgements  were  used  to  group  the  variables,  particularly 
when  the  different  estimates  were  discrepant.   More  weight 
was  placed  on  the  kappa  estimates  and  intraclass 
correlations  because  of  the  complex  nature  of  the  coding 
system  (Hops,  Davis,  &  Longoria,  1995;  Suen  &  Ary,  1989). 

The  reliability  estimates  were  interpreted  using 

84 


85 
several  general  guidelines.   First,  the  estimates  were 
judged  in  relation  to  accepted  standards  within  the 
literature  for  reliability.   Then,  the  similarity  between 
the  estimates  for  each  category  was  considered.   The 
reliability  estimates  for  categories  with  similar  percent 
agreement,  kappa  values,  and  intraclass  correlations  were 
thought  to  be  fairly  accurate  estimates.   The  categories 
with  discrepant  estimates  of  reliability  were  more  difficult 
to  interpret.   For  those  categories,  factors  that 
contributed  to  the  low  estimates  were  examined.   The 
frequency  of  occurrence  of  the  behavior  plus  the  number  of 
dyads  in  which  at  least  one  behavior  was  coded  were  factors 
that  appeared  to  impact  on  the  reliability. 

In  cases  where  the  reliability  estimates  were  based  on 
infrequent  occurrence  both  within  and  across  subjects,  the 
estimates  were  likely  to  be  affected  by  restricted  variance. 
For  example,  in  Table  17,  Physical  Negative  occurred  a  total 
of  two  times,  once  in  each  of  two  subjects.   On  one 
occasion,  both  coders  agreed,  leading  to  100%  agreement.   On 
the  second  occasion,  the  observers  disagreed  yielding  0% 
agreement.   The  average  percent  agreement  was,  therefore, 
50%.   For  this  category,  only  three  possible  percent 
agreement  values  could  occur:   0%,  50%,  and  100%.   Because 
of  the  limited  opportunity  to  code  this  behavior,  the  coders 
would  have  to  be  100%  accurate  across  subjects  to  meet  the 
standards  for  reliability  of  70%  or  greater  (Jones,  Reid,  S 
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Patterson,  1974).   In  other  words,  receiving  a  score  of  70%, 
the  standard  for  good  percent  agreement,  is  not  possible 
when  only  two  behaviors  are  coded  or  when  the  behavior 
occurs  in  so  few  participants.   The  resulting  reliability 
estimates  will  either  be  on  overestimate  or  an  underestimate 
simply  due  to  restricted  variance. 

Reliability  estimates  for  infrequently  occurring 
behaviors  and  estimates  for  behaviors  occurring  in  only  a 
few  subjects  also  are  likely  to  be  inconsistent  across 
studies.   Basic  statistical  principles  indicate  that  an 
estimate  based  on  a  single  measurement  is  less  reliable  and 
less  representative  of  the  population  mean  than  an  estimate 
based  upon  multiple  measurements  (Fleiss,  1986). 
Reliability  estimates  of  categories  with  a  moderate  base 
rate  will  likely  be  similiar  across  future  studies  using  the 
DPICS  II,  if  other  factors  remain  the  same  (e.g.,  coder 
training,  population).   The  reliability  estimates  that  are 
based  on  only  a  few  occurrences  sample  the  behavior 
insufficiently  to  obtain  a  stable  estimate  that  would  be 
generalizable  across  studies. 

Percent  agreement  can  be  difficult  to  interpret  when 
the  percent  agreement  is  based  on  widely  differing  frequency 
of  occurrence  of  a  behavior  within  the  participant  families 
(Hartman,  1977).   For  example,  if  a  participant  displays  10 
behaviors  on  which  the  raters  agree  on  eight  occurrences, 
the  raters  would  have  80%  agreement.   However,  if  another 


family  displays  only  two  of  the  same  behaviors,  and  the 
coders  disagreed  once  out  of  two  occurrences,  their 
agreement  will  be  50%  agreement  for  that  category,   when 
these  values  are  averaged  to  get  a  mean  agreement  for  the 
category,  the  overall  percent  agreement  is  65%. 

The  solution  to  this  problem  may  be  the  use  of  a 
weighted  average.   Using  the  above  example,  a  weighted 
average,  which  takes  into  account  the  differential 
frequency,  would  yield  a  percent  agreement  of  nine  agree 
divided  by  twelve  opportunities  for  agreement,  or  75% 
agreement.   Weighted  percent  agreement  is  included  in  the 
tables,  and  in  some  categories,  the  two  types  of  percent 
agreement  are  discrepant  (e.g.,  parent  Play  Talk).   Weighted 
average,  however,  does  not  account  for  chance. 

Some  researchers  have  noted  that  the  when  the  frequency 
of  occurrence  of  a  behavior  approaches  the  extremes  of  zero 
or  100%  of  the  total  behaviors,  the  higher  the  likelihood 
that  percent  agreement  will  be  inflated  by  chance  (Hartmann, 
1977;  Suen  S  Ary,  1989).   This  has  led  some  authors  to 
suggest  that  only  in  cases  where  the  frequency  of  occurrence 
is  between  20%  and  80%  of  the  total  behaviors  should  percent 
agreement  be  used  to  assess  reliability  (Suen  &  Ary,  1989). 
Overall,  percent  agreement  has  been  increasingly  criticized 
and  is  currently  considered  one  of  the  least  desirable 
methods  for  use  in  behavioral  observation  data  (Hops,  Davis, 
8  Longoria,  1995)  . 


Kappa  estimates  have  been  proposed  as  a  form  of 
reliability  that  corrects  for  chance  agreement.   Kappa 
estimates  are  computed  figuring  in  the  probability  of  the 
behavior  in  relation  to  other  behaviors.   In  addition,  Kappa 
estimates  can  be  helpful  in  identifying  common  coding 
errors.   The  "confusion  matrix"  that  is  obtained  in  the 
process  of  calculating  kappa  indicates  which  pairs  of 
categories  are  mistaken  for  one  another.   Tables  54  and  55 
in  Appendix  A  illustrate  the  confusion  matrices  for  the 
parent  and  child  verbalization  categories  and  Tables  56  and 
57  in  Appendix  A  illustrate  the  parent  and  child 
vocalization,  response,  and  physical  behavior  categories. 

Kappa  estimates  in  this  study  tended  to  be  higher  than 
the  percent  agreement  estimates.   The  kappa  estimates  are 
likely  elevated  somewhat  by  the  very  large  number  of 
behaviors  coded  overall.   The  confusion  matrix,  for  example, 
contained  14,495  coded  behaviors  for  all  of  the  parent 
verbalization  categories  for  both  groups  combined  across  all 
three  situations  (See  Table  54).   The  eguation  for  kappa 
includes  as  part  of  the  estimate,  the  number  of  agreements 
that  a  behavior  is  category  X  plus  the  number  of  times  that 
the  coders  agree  that  the  behavior  is  not  X  (i.e.,  agreement 
that  the  category  is  Y).   The  sum  of  the  proportion  of 
agreements  that  the  behavior  was  not  X  (i.e.,  the 
proportions  on  the  diagonal  in  a  confusion  matrix)  was 
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generally  quite  large  in  relation  to  the  total  number  of 
behaviors  coded  in  a  single  category. 

In  addition,  the  proportion  of  occurrence  of  the 
behavior  in  relation  to  the  other  behaviors  is  affected  by 
the  number  of  categories  and  thus  behaviors  included  in  the 
analysis.   The  kappa  estimate  is,  therefore,  affected  by  the 
number  of  other  categories  in  the  system  and  the  number  of 
behaviors  included  in  the  confusion  matrix.   For  DPICS  II 
observations,  the  kappa  estimate  was  typically  higher  than 
percent  agreement  because  the  confusion  matrix  reflected  the 
large  number  of  behaviors  being  coded. 

In  order  not  to  inflate  the  kappa  estimates  by 
including  additional,  non-related  categories,  the  present 
study  addressed  this  potential  problem  by  breaking  the 
categories  into  two  classes  of  behaviors,  one  containing  the 
verbalization  categories  and  one  containing  all  of  the 
vocalization,  physical  behaviors,  and  response  to  command 
and  question  categories.   These  classes  contain  the 
categories  that  are  likely  to  be  confused  with  one  another. 
For  instance,  Direct  Commands  could  be  confused  with 
Indirect  Commands,  questions,  and  descriptions  but  not  with 
Laugh.   Each  class  of  behaviors,  each  containing 
approximately  thirteen  categories,  was  analyzed  separately 
to  reduce  any  artificial  inflationary  effect.   Kappa 
estimates  for  parent  and  child  behaviors  also  were  computed 
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in  separate  confusion  matrices  to  reduce  the  likelihood  of 
an  overestiraation  of  the  reliability. 

Intraclass  correlations  were  included  in  the  study  to 
provide  an  alternative  method  to  evaluating  reliability. 
Intraclass  correlations  are  based  on  examining  the  amount  of 
variance  attributed  to  between  subjects  differences  and  the 
variance  attributed  to  within  subjects  differences,  or  in 
this  case,  coder  error.   The  correlation  coefficient  (P)  is 
interpretable  as  "...the  proportion  of  variance  of  an 
observation  due  to  subject-to-subject  variability  in  error- 
free  scores  (Fleiss,  1986,  p. 3)."   To  achieve  a  high 
intraclass  correlation,  the  variability  in  the  frequency  of 
occurrence  between  the  participants  must  be  greater  than  the 
variability  between  the  two  observers'  values  for  a  given 
behavioral  category  on  a  particular  subject. 

In  examining  all  of  the  reliability  estimates  for  the 
categories  of  the  DPICS  II,  the  majority  of  the  categories 
demonstrated  adequate  reliability  by  at  least  one  estimate. 
Those  categories  that  occurred  fairly  frequently  tended  to 
have  the  strongest  estimates.   A  number  of  the  categories  in 
the  "fair"  classification  tended  to  be  categories  with  a  low 
frequency  of  occurrence,  such  as  Behavioral  Descriptions, 
parent  Smart  Talk,  Physical  Negative,  and  Physical  Positive. 
The  probability  that  a  behavior  will  occur,  or  the  base 
rate,  likely  affects  the  coders  in  several  ways.   They  may 
have  less  practice  coding  these  low  base  rate  behaviors  and 
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have  less  chance  to  become  experienced  with  them  during 
actual  coding.   In  addition,  the  coders  preparedness  for 
infrequent  categories  differs  than  for  their  preparedness 
for  more  frequently  occurring  categories.   Because  the 
majority  of  these  categories  are  likely  to  have  a  low 
frequency  of  occurrence  regardless  of  the  sample  being 
observed,  coders  may  require  additional  training  in 
observing  these  categories  to  assure  adequate  reliability. 

The  reliability  estimates  of  the  other  categories  that 
were  ranked  as  "fair"  such  as  Noncompliance,  No  Opportunity 
for  Compliance,  No  Answer  and  No  Opportunity  for  Answer  were 
generally  based  on  sufficient  opportunities  to  code  these 
categories.   These  estimates  suggest  that  the  coders  had 
difficulty  discriminating  between  the  three  Response  to 
Question  categories  and  the  three  Response  to  Command 
categories  and  this  was  confirmed  by  examination  of  the 
confusion  matrix  (See  Tables  56  and  57).   Because  it  is 
crucial  to  have  an  accurate  estimate  of 

Compliance/Noncompliance,  it  will  be  very  important  to  use 
kappa  to  examine  the  errors,  at  the  level  of  the  specific 
behaviors,  made  with  this  category  during  training.   The 
Response  to  Questions  categories  are  new  to  the  revised 
version  of  the  system  and  have  yet  to  demonstrate  their 
utility.   If  future  psychometric  studies  do  not  strongly 
support  the  use  of  this  set  of  categories,  they  will  be 
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dropped  from  the  system  so  that  the  coders  will  have  fewer 
behaviors  to  attend  to. 

A  final  set  of  categories,  in  the  "insufficient  data" 
classification,  were  those  categories  that  simply  did  not 
occur  with  sufficient  frequency  to  calculate  a  reliability 
estimate.   The  parent  categories  of  Yell,  Destructive, 
Warning  and  Contingent  Labeled  Praise,  and  the  child 
categories  of  Reflection  and  Labeled  Praise,  occurred  so 
infrequently  (or  not  at  all)  that  no  estimate  could  be  made 
of  their  reliability.   Although  these  categories  occurred 
infrequently  in  the  sample  of  parent-child  dyads  evaluated 
in  this  study,  it  is  possible  that  the  parent  Yell  or 
Destructive  may  occur  in  a  pre-treatment  clinic-referred 
sample  on  occasion.   Parent  Contingent  Labeled  Praise  and 
Warning  and  child  Reflection  and  Labeled  Praise  might  also 
occur  on  occasion  in  a  post-treatment  sample.   Therefore, 
these  categories  should  remain  in  the  system  until  their 
usefulness  in  studies  with  a  pre-  and  post-treatment  design 
has  been  evaluated. 

The  results  of  the  study  point  to  the  importance  of 
accurately  identifying  those  dyads  in  which  inappropriate 
behaviors  (e.g.,  Critical,  Smart  Talk,  Physical  Negative, 
Yell,  etc.)  occur  because  of  their  power  to  discriminate 
between  children  with  significant  behavior  problems  and 
those  without.   The  poor  reliability  estimates  in  some  of 
the  inappropriate  behavior  categories  found  in  this  study 
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(i.e.,  child  Physical  Negative,  parent  Destructive,  parent 
Yell)  indicate  that  further  work  needs  to  be  done  to  define 
these  categories  and/or  additional  training  needs  to  be 
conducted  with  the  coders  in  order  to  consistently  attain 
accepted  standards  of  reliability. 

Should  it  remain  difficult  to  attain  higher  reliability 
estimates  even  after  additional  training,  because  of  the 
infrequent  occurrence  of  these  categories  (i.e.,  parent 
Yell,  parent  Destructive,  child  Yell),  the  inappropriate 
behavior  categories  could  be  combined  and  coded  as  a  single 
variable  that  does  not  require  discrimination  among  the 
narrower  behaviors.   The  observers  would  not  have  to  make 
fine  distinctions  between  types  of  behavior,  and  this  would 
likely  increase  the  reliability  of  the  summary  variable  for 
inappropriate  behavior. 

Validity 

Behavioral  differences  between  clinic-referred  and  non- 
referred  families 

The  results  of  this  study  replicate  previous  findings 
of  behavioral  differences  between  children  with  behavior 
problems  and  their  mothers  and  children  without  behavior 
problems  and  their  mothers.   First,  child  compliance  was 
significantly  different  between  the  two  groups.   The  clinic- 
referred  children  on  average  across  the  three  situations 
were  compliant  with  53%  of  parental  total  commands  compared 
to  the  non-referred  group  who  were  compliant  to  75%  of 
parental  total  commands. 
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It  is  important  to  note  that  the  compliance  ratio 
described  here  includes  the  child's  compliance  to  both 
direct  (also  known  as  "alpha"  commands)  and  indirect 
commands  and  represents  compliance  across  the  three 
situations.   The  compliance  ratios  found  in  the  present 
study  are  fairly  similar  to  previous  DPICS  studies.   In  the 
DPICS  standardization  article  (Robinson  &  Eyberg,  1981),  the 
compliance  ratios  for  PDI  were  62%  for  the  non-referred 
group  and  48%  for  the  clinic-referred  group.    Eyberg  and 
Robinson  (1982)  found  pre-treatment  compliance  ratios  of  39% 
in  PDI  for  a  sample  of  clinic-referred  children.   In 
contrast,  Griest,  Wells,  Forehand,  and  McMahon  (1980)  found 
compliance  ratios  for  total  commands  to  be  26.9%  for  the 
clinic-referred  group  and  33.2  for  the  non-referred  group 
using  their  own  coding  system.   The  variability  in 
compliance  ratios  between  studies  likely  reflects 
differences  in  the  situations  in  which  it  is  measured  as 
well  as  different  definitions  of  compliance  across  systems. 
In  spite  of  the  differences  in  definitions  across  studies, 
in  each  of  these  studies,  the  compliance  ratios  were 
significantly  different. 

Second,  the  frequency  of  inappropriate  behaviors  was 
quite  different  between  the  groups.   Clinic-referred 
children  averaged  approximately  31  inappropriate  behaviors 
in  the  15  minute  observation  period  while  the  non-referred 
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children  engaged  in  an  average  of  10  inappropriate  behaviors 
in  the  same  length  of  time. 

The  prosocial  behaviors  of  the  children,  however,  were 
not  found  to  be  significantly  different.   This  finding  is 
consistent  with  the  findings  of  Patterson  (1976)  who  also 
did  not  find  codable  differences  in  the  prosocial  behaviors 
of  conduct-problem  children.   It  is  possible  that  the 
variable  quantifying  prosocial  behavior  is  not  sensitive  to 
the  nature  of  the  prosocial  deficits  of  these  children.   In 
this  study,  prosocial  behavior  was  operationalized  as  the 
sum  of  several  categories  of  child  verbalizations,  Physical 
Positive,  Answer,  and  Laugh.   One  potential  problem  with 
this  definition  of  prosocial  is  that  the  verbalization 
categories  only  partially  account  for  the  content  of  the 
children's  speech.   For  example,  as  long  as  the  child  does 
not  whine  or  speak  in  a  sarcastic  tone  of  voice,  statements 
such  as  "I  don't  want  to  play  with  you"  and  "I  want  these 
toys  for  myself"  would  be  coded  as  one  of  the  prosocial 
categories.   It  seems  then  that  studies  examining  prosocial 
behavior  with  the  DPICS  II  should  refine  the  definition  of 
what  constitutes  prosocial  behavior  for  children  and  test  it 
empirically  to  have  a  more  accurate  and  sensitive  measure. 

The  present  study  also  replicated  previous  findings 
related  to  parent  behavior.   Mothers  of  clinic-referred 
children  exhibited  significantly  more  inappropriate 
behaviors  (e.g.,  Criticism)  than  comparison  mothers.   Over 
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the  fifteen  minutes  that  dyads  were  observed,  the  referred 
mothers  emitted  approximately  20  inappropriate  behaviors 
compared  to  an  average  of  5  inappropriate  behaviors  from  the 
comparison  mothers.   Total  commands  used  during  the  15 
minutes  and  the  use  of  direct  commands  were  also 
significantly  different  between  the  two  groups  of  mothers. 
The  mothers  of  clinic-referred  children  used  significantly 
more  commands  and  a  higher  percentage  of  those  commands  were 
direct. 

It  appears  that  untreated  clinic-referred  mothers  tend 
to  utilize  predominantly  direct  commands  (in  this  study 
72%).   Nonetheless,  their  children  were  not  compliant  with 
their  requests.   Direct  commands  alone  do  not  appear  to  lead 
to  child  compliance.   During  PCIT,  the  parent  is  taught  to 
utilize  direct  commands  so  that  it  is  clear  to  the  child 
what  behavior  is  expected.   Yet  it  may  be  other  aspects  of 
their  commands  or  other  behaviors  that  are  taught  in 
treatment  that  account  for  increased  compliance.   Other 
changes  in  parent  behavior  between  baseline  and  post- 
treatment  behavior  include  the  increase  in  consistent 
consequences  for  compliance  and  noncompliance.   The  ratio  of 
direct  commands  then  may  not  change  from  pre-  to  post- 
treatment,  but  other  aspects  of  the  parents'  behavior  do 
change  to  reduce  the  child's  noncompliance. 

Other  important  differences  were  noted  in  the  parent 
behaviors  between  the  clinic-referred  and  non-referred 
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groups.   Parent  prosocial  behaviors  differentiated  the  two 
groups  of  mothers.   The  summary  variable  of  parent  Prosocial 
Behavior  included  the  categories  of  Answer,  Acknowledgement, 
Behavioral  and  Information  Descriptions,  Laugh,  Labeled  and 
Unlabeled  Praise,  Reflections,  and  Physical  Positive.   The 
non-referred  mothers  issued  an  average  of  121  (SD  =  34.6) 
prosocial  behaviors  and  the  clinic-referred  mothers  issued 
an  average  of  93  (SD  =  29)  prosocial  behaviors  during  the  15 
minutes  of  observation.   This  finding  has  not  been 
consistently  demonstrated  in  other  studies  comparing 
referred  and  non-referred  groups.   Griest,  Forehand,  Wells, 
and  McMahon  (1980)  found  no  differences  between  groups  on 
total  positive  attention  and  contingent  positive  attention. 
Webster-Stratton  (1985)  found  that  Praise  was  significantly 
different  between  clinic  and  nonclinic  groups,  but  found  no 
differences  between  groups  on  questions,  Physical  Positive, 
and  Descriptive  and  Reflective  Comments. 

The  difference  in  prosocial  behavior  found  in  the 
present  study  and  other  differences  between  groups  that  were 
observed  but  not  systematically  measured  suggest  avenues  for 
future  research.   For  example,  the  comparison  mothers 
appeared  to  gain  their  child's  compliance  through  fairly 
indirect  means.   Comparison  group  mothers  tended  to  use 
questions,  suggestions,  games,  and  songs  to  cue  the  child  to 
clean-up.   The  comparison  mothers  also  tended  to  wait  before 
repeating  a  command/direction,  which  would  account  for  the 
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finding  that  they  give  fewer  commands  overall.   It  also 
appeared  that  noncompliance  in  the  non-referred  children 
typically  did  not  lead  to  the  mother  increasing  her  level  of 
negativity  (e.g,  criticism,  whining).   These  observations 
could  be  empirically  evaluated  in  follow-up  studies. 

Another  research  guestion  could  focus  on  the  actual 
completion  of  the  clean-up  task.   This  study  did  not  include 
a  measure  of  whether  the  toys  were  completely  cleaned  up  or 
not  to  determine  if  one  group  was  more  successful  at  getting 
the  children  to  put  away  their  toys.   This  could  have  been 
accomplished  by  measuring  the  percentage  of  toys  put  away  at 
the  end  of  the  five  minutes  of  clean-up  and  rating  the 
degree  of  parental  assistance  used. 

Effect  of  Socioeconomic  Status  on  Behavior  Problems 
Although  attempts  were  made  to  collect  demographically 
similar  samples,  the  two  groups  were  found  to  be 
significantly  different  on  ratings  of  SES.   Although  this 
SES  difference  can  be  seen  as  a  confound  in  the  data  that 
should  be  controlled  for  in  analyses,  another  view  of  the 
SES  difference  between  clinic-referred  and  non-referred  can 
be  taken.   The  literature  has  shown  that  children  referred 
for  behavior  problems  often  contain  a  significant  proportion 
of  lower  SES  families.   It  is  possible  then,  that  SES  is  an 
important  risk  factor  that  should  be  included  in  attempts  to 
identify  children  with  behavior  problems.   Conseguently ,  in 
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this  study,  SES  was  controlled  for  in  some  analyses  and 
included  in  others  as  a  variable. 

As  predicted,  SES  alone  did  not  solely  account  for  the 
differences  between  groups  on  the  DPICS  II  categories  or  on 
the  parents'  responses  to  questionnaires.   Some  significant 
findings  related  to  SES  were  found.   The  behaviors  of  the 
low  SES  dyads  during  the  DPICS  II  observations  differed  from 
the  higher  SES  dyads.   Based  on  the  correlation  matrices, 
the  mothers  in  the  lower  SES  families  were  more  likely  to 
engage  in  inappropriate  behavior  (e.g.,  Critical,  Smart 
Talk,  Physical  Negative),  use  a  higher  proportion  of  Direct 
Commands,  and  use  more  total  commands  than  higher  SES 
mothers.   The  children  in  the  lower  SES  families  also  were 
more  likely  to  engage  in  inappropriate  behavior.   The 
inclusion  of  SES  as  a  variable  in  the  stepwise  discriminant 
analysis  with  untransformed  values  increased  the 
classification  rate  from  81.6%  to  91.6%  using  the 
conservative  estimate  provided  by  the  jacknifing  technique. 

Lower  SES  parents  also  responded  differently  to 
questionnaires  than  families  with  higher  SES.   SES  accounted 
for  13%  of  the  variance  (p_  <  .01)  in  the  PSI  child  domain 
scores  and  6%  (p.  <  .05)  of  the  variance  in  the  parent  domain 
score.   Lower  SES  families  were  also  more  likely  to  have 
elevations  in  their  ECBI  Intensity  Score.   SES  accounted  for 
12%  of  the  variance  (p_  <  .01)  in  ECBI  intensity  scores. 
Finally,  lower  SES  parents  reported  having  less  feeling  of 
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control  over  their  child's  behavior  based  on  their  PLOC 
score.   SES  accounted  for  10%  of  the  variance  in  the  PLOC 
score  (p.  <  . 05 ) . 

These  findings  are  consistent  with  several  studies 
highlighting  the  vulnerability  of  children  in  lower  SES 
families  to  developing  behavioral  problems.   Although  the 
present  study  was  not  designed  to  evaluate  possible  causal 
relationships  between  behavior  problems  and  economic 
hardship,  it  does  suggest  that  children's  behavior  as  well 
as  parents'  behavior  may  reflect  their  economic 
circumstances.   SES  might  then  be  considered  a  risk  factor 
for  children  developing  behavior  problems. 

A  possible  explanation  for  the  finding  that  SES  is 
related  to  behavior  problems  in  children  is  that  when 
parents  are  stressed  by  socioeconomic  factors  and  are 
"insular"  (i.e.,  have  few  social  contacts  and  these  contacts 
are  often  aversive  (Wahler,  Hughey,  &  Gordon,  1981),  they 
tend  to  utilize  more  negative  control  strategies.   As  their 
stress  increases  so  does  their  use  of  negative  control 
strategies  (e.g.,  commands,  criticism).   Under  these 
conditions,  the  children  respond  by  increasing  their 
negative  behavior  (e.g.,  noncompliance,  whining).   The 
children's  negative  behaviors  increase  the  parents'  stress 
and  the  parents  further  increase  their  use  of  negative 
control  strategies. 
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Limitations  and  Future  Directions 
It  is  a  fairly  labor-intensive  effort  to  collect  and 
code  behavioral  observation  data.   Consequently,  only 
mothers  of  the  children  were  included  in  the  present  samples 
to  establish  the  basic  reliability  and  validity  of  the 
system.    Future  studies  on  the  DPICS  II  would  benefit  from 
the  inclusion  of  father  data  and  the  analysis  of  differences 
between  the  behavior  of  fathers  of  referred  and  non-referred 
children.   It  is  perhaps  a  good  strategy  in  initial  studies 
of  a  coding  system  to  evaluate  the  system  on  a  sample  of 
mothers  only,  and  then  when  the  system  has  been  refined, 
father  data  could  be  evaluated. 

The  difference  between  groups  on  SES  presents  a 
limitation  on  the  data  and  results.   It  would  be  helpful  to 
replicate  these  results  with  a  low  SES  non-problem  sample  of 
mother-child  dyads.   In  addition,  these  results  are  based  on 
a  predominantly  Caucasian  sample  of  children.   Studies  that 
focus  on  the  dyadic  interactions  of  referred  and  non- 
referred  ethnic  minority  groups  may  reveal  significant 
differences  than  the  present  results.   For  example,  Eyberg 
(1995)  suggested  that  categories  such  as  praise  be  evaluated 
for  functional  differences  between  ethnic  minority  groups. 
Given  the  sample  characteristics,  the  results  on  the 
non-referred  group  presented  in  the  current  study  provide 
normative  information  about  middle  class  Caucasian  children 
and  their  mothers.   Without  further  study  of  non-referred 
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minorities,  it  would  be  premature  to  utilize  the  data  from 
the  present  non-referred  group  as  a  guideline  to  evaluate 
children  from  other  backgrounds.   It  would  be  interesting  to 
compare  the  behaviors  of  mothers  and  their  children  from 
different  ethnic  groups  to  determine  if  there  are 
significant  differences. 

The  relatively  low  reliability  estimates  on  some  of  the 
categories  indicates  that  additional  training  may  need  to  be 
done  with  the  coders.   Intraclass  correlations  may  be  useful 
during  the  training  phase  to  distinguish  systematic  errors 
in  coding  by  observers.   A  description  of  a  design  for 
evaluating  systematic  coding  errors  is  described  by  Fleiss 
(1986).   In  his  design  for  the  interexaminer  reliability 
study,  adapted  for  DPICS  II,  each  of  the  coders  would 
observe  the  same  set  of  participants.   To  be  feasible,  a 
small  randomly-selected  subset  of  participants  could  be 
drawn.   If  all  of  the  coders  observe  all  of  the 
participants,  it  can  be  determined  using  intraclass 
correlations  if  there  is  a  systematic  difference  or  bias  in 
the  coders'  use  of  the  categories.   This  design  may  be  quite 
helpful  in  determining  if  a  coder  is  ready  to  begin  actual 
coding  for  data  purposes,  by  comparing  their  scores  to  the 
scores  of  active  coders  on  the  same  set  of  data.   It  could 
also  be  helpful  in  determining  if  coders  have  drifted  from 
their  original  standards  by  having  them  recode  a  set  of  data 
they  and  other  observers  have  coded  previously.   Unlike  the 
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kappa  estimates,  intraclass  correlations  can  identify  error 
as  a  function  of  a  particular  coder.   With  kappa  estimates, 
the  "confusion  matrix"  can  identify  what  errors  were  made, 
but  cannot  as  easily  identify  which  coder  makes  the  errors 
or  if  one  coder  makes  systematic  differences  in  coding 
compared  to  other  observers. 

Finally,  the  results  of  the  study  highlight  the  need 
for  observers  to  identify  reliably  the  occurrence  of  low 
base  rate  behaviors,  particularly  inappropriate  behaviors. 
It  is  unclear  whether  the  DPICS  II  manual  needs  to  further 
clarify  the  coding  rules  for  vocalizations  and  for  physical 
behaviors,  whether  further  training  alone  would  improve  the 
reliability  estimates  for  these  behaviors,  or  whether  these 
categories  should  be  combined  into  a  composite  category  for 
inappropriate  behavior.   In  future  applications  of  the  DPICS 
II,  coding  of  the  inappropriate  behavioral  categories  should 
be  emphasized  more  heavily  in  training.  It  is  also 
recommended  that  either  during  the  coding  or  the  analysis 
process,  the  inappropriate  behaviors  categories  be  combined 
into  one  summary  variable  to  increase  the  reliability. 

In  future  projects  utilizing  the  DPICS  II,  the 
researchers  may  wish  to  limit  the  categories  coded  to  a 
subset  of  the  entire  system  that  is  relevant  to  their 
research  question.   By  limiting  the  number  of  categories, 
the  coding  will  be  less  demanding  on  the  observers  for  both 
their  attention  and  the  time  required  to  observe.   Limiting 
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the  categories  also  is  likely  to  increase  the  reliability 
estimates . 

Given  that  Kappa  estimates  and  intraclass  correlations 
are  more  suitable  for  more  complex  coding  systems  (Hops, 
Davis,  &   Longoria,  1995),  these  reliability  statistics 
should  be  calculated  in  future  studies  utilizing  the  DPICS 
II.   Percent  agreement  did  not  appear  to  be  suitable 
particularly  for  the  low  frequency  of  occurrence  behavioral 
categories . 

With  the  exception  of  child  Prosocial  Behavior 
categories,  all  hypothesized  categories  and  summary 
variables  differentiated  the  two  groups.   Future  studies 
that  compare  a  non-problem  sample  of  children  to  a  clinic- 
referred  sample  could  include  these  same  categories. 

Additional  analyses  of  these  data  could  be  completed. 
An  independent  sample  of  children  could  be  analyzed  using 
the  discriminant  analysis  results  from  this  study  to 
determine  the  predictive  power  of  the  discriminant  function 
reported  here.   This  additional  analysis  would  provide 
confirmation  of  the  utility  and  generalizability  of  the 
function  described  in  the  results. 

In  addition,  the  complexity  of  the  coding  system, 
particularly  its  exhaustive  coding  of  each  consecutive 
behavior,  lends  itself  to  lag  sequential  analysis.   Other 
researchers  employing  this  technique  have  found  patterns  of 
behavior  that  differentiate  types  of  clinic-referred  dyads. 
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Dumas  (1984),  for  example,  evaluated  conditional 
probabilities  for  parent  and  child  aversive  behavior  and 
found  that  mothers  who  were  unsuccessful  in  parent  training 
were  more  aversive  and  indiscriminate  in  their  behavior  to 
their  children.   It  is  possible  that  a  comparison  of 
sequences  of  behaviors  would  differentiate  referred  and  non- 
referred  parent-child  dyads.   For  example,  future  studies 
could  evaluate  the  conditional  probabilities  of  behaviors 
following  child  and  parent  prosocial  behaviors,  such  as 
praise,  descriptions,  and  reflections,  and  inappropriate 
behaviors,  such  as  noncompliance,  criticism,  and  whining. 

In  summary,  the  present  study  demonstrates  that  the 
DPICS  II  can  be  used  reliably  and  is  valid  for  use  with 
children  with  behavior  problems.   It  fulfills  the  criteria 
established  for  behavioral  observation  coding  systems  as 
described  by  Roberts  and  Forehand  (1978)  as  an  assessment 
device  for  children  and  has  a  variety  of  applications  both 
in  clinical  and  research  settings. 


APPENDIX  A:   TABLES 


Table  3 

Summary  of  Reliability  for  Parent  Categories  in  the  Child 
Directed  Interaction 


CATEGORY 


Direct  Command 

Indirect  Command 

Information  Question 

Descriptive/Reflective 
Question 

Behavioral  Description 

Information  Description 

Reflective  Statement 

Acknowledgment 

Labeled  Praise 

Unlabeled  Praise 

Criticism/Smart  Talk 

Playtalk 


%  agree 


.65 

67% 

.66 

.60 

36% 

.46 

.82 

87% 

.82 

.92 

81% 

.78 

.93 

78% 

.76 

.89 

82% 

.71 

.73 

71% 

.69 

.91 

77% 

.74 

.25 

25% 

.29 

.93 

77% 

.45 

.45 

33% 

.17 

.99 

75% 

.74 

Not_e:   Based  on  twenty  dyads.   Mean  percent  agreement  was 
calculated  by  summing  the  agreements  across  subjects  and 
dividing  by  the  coders'  agreements  plus  disagreements  across 
subjects. 
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Table  4 

Summary  of  Reliability  for  Parent  Categories  In  Parent 
Directed  Interaction 


CATEGORY 


Direct  Command 

Indirect  Command 

Information  Question 

Descriptive/Reflective 
Question 

Behavioral  Description 

Information  Description 

Reflective  Statement 

Acknowledgment 

Labeled  Praise 

Unlabeled  Praise 

Criticism/Smart  Talk 

Playtalk 


agree 


.90 

82% 

.72 

.85 

62% 

.59 

.96 

85% 

.76 

.87 

74% 

.72 

4  7 

40% 

.24 

83 

77% 

.67 

69 

65% 

.59 

80 

67% 

.65 

72 

17% 

.13 

9  0 

71% 

.76 

74 

69% 

.76 

99 

81% 

.86 

Note:  Based  on  twenty  dyads.   Mean  percent  agreement  was 
calculated  by  summing  the  agreements  across  subjects  and 
dividing  by  the  agreements  plus  disagreements  across 
subjects. 
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Table  5 

Summary  of  Reliability  for  Child  Categories  in  the  Child 
Directed  Interaction 


CATEGORY  £  %  agree 


Compliance 

.38 

80% 

.77 

Noncompliance 

.90 

67% 

.74 

No  Opportunity  for 
Compliance 

.45 

88% 

.88 

Answer 

.73 

94% 

.89 

No  Answer 

.44 

56% 

.59 

No  Opportunity  for  Answer 

.91 

75% 

.80 

Smart  Talk 

* 

* 

* 

Criticism 

* 

* 

* 

Yell 

* 

0% 

.0 

Whine 

.01 

11% 

.17 

Physical  Negative 

-A 

* 

* 

Destructive 

* 

* 

* 

Note:   *  indicates  calculations 

that 

could 

not  be 

computed. 
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Table  6 

Summary  of  Reliability  for  Child  Categories  in  the  Parent 
Directed  Interaction 


CATEGORY 


Whine  * 


Destructive  * 


%  agree 


Answer  .82  82% 

No  Answer  .63  71% 

No  Opportunity  for  .94  84% 
Answer 


* 


Physical  Negative  *  * 


* 


Compliance  .83  84%         .95 

Noncompliance  .93  39%  57 

No  Opportunity  for  .79  83% 
Compliance 


.85 

.83 
.54 
.89 


Smart  Talk  * 

Criticism  * 

Yell  *  *  * 


Note:   *  indicates  calculations  that  could  not  be  computed. 
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Table  8 

Mean  Frequency  of  DPICS  II  Categories  for  Referred  and  Non- 
Referred  Mother-Child  Dyads  during  the  Child-Directed 
Interaction 


PARENT  CATEGORIES  Clinic-referred  Non-referred 

M     (SD)        M       (SD) 


Direct  Command  1.9  2.8  16  16 

Indirect  Command  .35  .59  gg  gg 

Information  Question  6.1  4.1  5.3  27 

Descriptive/Reflective  10. 1  6.1  9.9  55 
Question 

Behavioral  Description  .15  .67  .95  17 

Information  Description*  10.7  6.6  15.3  72 


Reflective  Statement  1.3    2.2       35 

Acknowledgment**  3.5    2.0       7  7 


2.0 

4.1 
Labeled  Praise  .55    1.4        10      3, 


Unlabeled  Praise  1.2    16       15 

Criticism/Smart  Talk  .65 


Playtalk  .75    16       41 

*  P  <  .05.   **  p  <  .01.  =™==="™™ 


3.0 


1-1       .50     1.1 
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Table  9 

Mean  Frequency  of  DPICS  II  Categories  for  Referred  and 
Nonreferred  Mother-Child  Dyads  during  the  Child-Directed 
Interaction 


CHILD  CATEGORIES  Clinic-referred   Non-referred 

M      (SD)        M       (SD) 


Compliance                   1 . 2 

1  .9 

.88 

.90 

Noncompliance                .36 

.63 

.17 

.51 

No  Opportunity  for  Compliance  1  .5 

1  .4 

1  .3 

.33 

Answer                      3  _ 5 

1  .8 

3.1 

1  .8 

No  Answer                   1  _  -\ 

1  .1 

.95 

1  .2 

No  Opportunity  for  Answer     1.7 

2.1 

1  .2 

1  .8 

Smart  Talk                   .05 

.22 

.05 

.22 

Criticism                   .05 

.22 

.00 

.00 

Yell                        .15 

.67 

.20 

.89 

Whine                         .00 

.00 

.50 

1  .8 

Physical  Negative            .00 

.00 

.00 

.00 

Destructive                  .05 

.22 

.05 

.22 

P  <  .05.     p  <  .01. 
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Table  10 

Mean  Frequency  of  DPICS  II  Parent  Categories  for  Referred 
and  Nonreferred  Mother-Child  Dyads  during  the  Parent- 
Directed  Interaction 


PARENT  CATEGORIES  Clinic-referred  Non-referred 

M     (SD)       M       (SD) 


Direct  Command  11.5  8.4  6.8  5.6 

Indirect  Command  6.6  4.0  4.8  39 

Information  Question  4.5  4.2  5.7  4.5 

Descriptive/Reflective  7.3  3.8  9.4  47 
Question 

Behavioral  Description  .15  .37  .35      57 

Information  Description**    17.7  7.4  26.4  9.0 

Reflective  Statement  .50  .69  1.1  16 

Acknowledgment**  2.4  1.5  5.1  31 

Labeled  Praise  .25  .64  .20  .52 

Unlabeled  Praise**  .65  .93  2  4  2  1 

Criticism/Smart  Talk*  2.1  2.6  .85  11 

Playtalk*  .40  _88  53  ,QQ 

*  p  <  .05.   **  p  <  .01.  """ -~— "■———— — — 


114 
Table  11 

Mean  Frequency  of  DPICS  II  Child  Categories  for  Referred  and 
Nonreferred  Mother-Child  Dyads  during  the  Parent-directed 
Interaction 

CHILD  CATEGORIES  Clinic-referred   Non-referred 

M     (SD)        M       (SD) 


Compliance 

3.6 

2.3 

3.9 

3.3 

Noncompliance 

6.1 

6.2 

1  .3 

2.3 

No  Opportunity  for 
Compliance 

8.2 

7.9 

6.4 

5.6 

Answer 

3.1 

2.7 

2.3 

2.1 

No  Answer 

.76 

1  .1 

.75 

.91 

No  Opportunity  for  Answer 

1  .4 

1  .7 

2.7 

3.8 

Smart  Talk 

1  .4 

3.0 

.05 

.22 

Criticism 

.15 

.49 

.05 

.22 

Yell 

.95 

3.3 

.00 

.00 

Whine 

.45 

1  .2 

.10 

.31 

Physical  Negative 

.55 

2.2 

.00 

.00 

Destructive 

.15 

.49 

.00 

.00 

p  <  .05.     p  <  .01  . 
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Table  12 
Correlations  between  SES  and  selected  DPICS  II  variables  in 


the 

Child 

Directed 

Interact 

ion. 

Parent 

Directed 

Tnt 

=raction. 

and 

Clean 

-Up 

DPICS  II 

Category 

SES 

CDI 

PDI 

CU 

PARENT  BEHAVIOR 

Criticism  .29* 

(E=-04) 

Direct  Command  -.41 

(E=-00) 

Indirect  Command  -.12 

(E=-41) 

Labeled  Praise  -.30 

(E=-07) 

Unlabeled  Praise  .07 

(E=-66) 

CHILD  BEHAVIOR 

Compliance 


Noncompliance 

No  Opportunity  for 
Compliance 

Physical  Negative 

Criticism 

Smart  Talk 


- 

.27 

<£- 

=  .06) 

_ 

31* 

<E= 

=  .03) 

_ 

39** 

(E= 

.01) 

19 

(E= 

.19) 

14 

(E= 

.35) 

05 

(E- 

.75) 

-.14 
(E=-34) 

-.11 
(E=-45) 

-.12 
(E=-41) 

-.30* 

(E=-04) 

.22 

(E=-12) 

-.02 
(E=-91) 

.26 
(E=-08) 

.28 
(E=-06) 

.29 

(E=-04) 

.46** 

(E=-00) 

-.02 
(E=-92) 

.10 
(E=-49) 

-.08 
(E=-61) 

-.27 
(E=-07) 

.04 
(£=•79) 

-.27 
(E=.07) 

.07 
(E=.62) 

-.00 
(E=-98) 

.18 
(E=-22) 

-.40 

(E=-006) 

-.31* 
(E=-03) 

-.36** 

(E=-01) 

Note:   n  =  47  for  all  analyses. 
E  <-05.   **_p  <.01 . 
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Table  13 

Correlations  between  PPVT-R  and  selected  DPICS  II  variables 
in  the  Child  Directed  Interaction,  Parent  Directed 
Interaction,  and  Clean-Up 


PARENT  BEHAVIOR 

Criticism 


CHILD  BEHAVIOR 


DPICS  II  Category  PPVT-R 


CDI         PDI         CU 


-.17        -.27 
(£=.25)     (E=.07) 


Direct  Command  -.28        -  17        -  23 

(E=-26)     (e='.12) 


Indirect  Command  -.05        -  12 


Unlabeled  Praise  .07        -  12 


- 

.06 

(E= 

.69) 

_ 

.28 

(E= 

.06) 

_ 

.05 

(E= 

.73) 

07 

(E= 

.63) 

Note:  n  =  47  for  all  analyses. 
E  <  .05.    E  <  .01 . 


-.11 


(E=.40)     (e=.45) 


-.12 


(E=.41)     (e=-40) 


Compliance                  -.30*        .16  -.04 

(E=-04)  (e=-28)  (e='-78) 

Noncompliance                 -.09        -  28  -  17 

(E=-54)  (e=-06)  (E='-27) 

No  Opportunity  for            -.21         -  23  -  25 

Compliance               (£=.15)  (e='-12)  (e='.09) 

Destructive                   -.02        -  29  27 

(E=-90)  (e=-05)  (e=-07) 

Physical  Negative            -.12        -.21  09 

(E=-41)  (e=-15)  (e=.52) 

Smart  Talk                   _.02        __27  ^_Q6 

(E=.91)  (e=-07)  (£=.67) 
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Table  15 
Characteristics  of  Clinic-Referred  Groups 


Variable             CI 

Total 
inic-referred 
(n  =  84) 

Randomly-selected 

Clinic-referred 

(n  =  30) 

Sex  of  child  (%  male) 

80% 

77% 

Mean  child  age  (months) 

53.0 

58.5 

Family  composition  (%) 
Two-parent 
Single-parent 

60.0 
40.0 

60.0 
40.0 

Maternal  age  (years) 

31  .2 

30.7 

Maternal  education3 

4.3 

4.2 

Maternal  employment  (%) 
Employed 
Not  employed 

57.6 
42.4 

63.3 
36.7 

Ethnicity  (%) 
Caucasian 
African  American 
Hispanic 
Other 

73.0 

18.0 

5.0 

4.0 

80.0 

10.0 

7.0 

3.0 

PPVT-R  standard  score 

M  91.8  95.1 


37.1  38.3 


SES 

M 

Holl 

ingshead  SES  (n) 

Class 

V 

Class 

IV 

Class 

III 

Class 

II 

Class 

I 

8.2%  3.3% 

22.4%  26.7% 

28.3%  23.3% 

34.1%  36.7% 

7.0%  10.0% 


Maternal  education  was  assessed  on  a  scale  of  1  to  7,  with 
one  representing  less  than  7  years  of  education,  and  seven 
representing  a  graduate  degree. 
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Table  18 

Summary  of  Reliability  for  Parent 

Categories  in  the  Chi 

Id 

Directed  Interaction — CI 

inic-re 

ferred  Group 

CATEGORY 

Sum3 

§h 

Mean 
%  Agree 

Weighted 
%  Agree 

k 

Direct  Command 

120 

23 

80% 

77% 
(68%-85%) 

.68 

Indirect  Command 

39 

19 

51% 

54% 
(36%-72%) 

.64 

Information  Question 

214 

29 

87% 

87% 
(81%-93%) 

.87 

Descriptive /Reflective 
Question 

336 

30 

78% 

79% 
(75%-84%) 

.71 

Behavioral  Description 

13 

8 

58% 

62% 

(28%-95%) 

.89 

Information  Description 

415 

30 

73% 

76% 
(72%-81%) 

.68 

Reflective  Statement 

30 

19 

33% 

38% 

(23%-54%) 

.47 

Acknowledgment 

267 

30 

66% 

67% 
(62%-72%) 

.67 

Labeled  Praise 

0 

0 

— 

— 

— 

Unlabeled  Praise 

28 

15 

66% 

87% 
(75%-99%) 

.83 

Contingent  Praise 

0 

0 

— 

— 

— 

Criticism 

54 

21 

47% 

57% 
(46%-68%) 

.58 

Smart  Talk 

2 

2 

50% 

( 

50% 
-585%-685%) 

1  .0 

1  19 


Table  18  continued 


CATEGORY  Suma  Uh       Mean    Weighted     k 


Agree   %  Agree 


Destructive  0      0    —       —       — 

Physical  Positive         7      9    22%      17%       .33 

(-14%-47%) 

Physical  Negative         1      2    50%      50%       1.0 

(-585%-685%) 

Playtalk  35    17    52%       47%        .49 

(28%-65%) 

Laugh  63    22    58%       68%        .92 

(55%-81%) 

Whine  0      2     0%       —        .00 

Yell  0      0 

Answer  64    21    75%       79%        .98 

(69%-89%) 

No  Answer  13    11    44%      44%       .62 

(14%-73%) 

No  Opportunity  for  Answer  18    11    35%      41%       .67 

(22%-59%) 

Compliance  38    15    53%      60%       .77 

(42%-78%) 

Noncompliance  9     10    15%      23%       .49 

(-.83%-47%) 

No  Opportunity  for         104   25    59%       63%        .82 
Compliance  (55%-71%) 

Warning  0     0     —       —       — 


Note:   All  analyses  based  on  n  =  30.   Dashes  indicate 
calculations  that  could  not  be  computed. 

a  Sum  refers  to  the  total  number  of  behaviors  coded  across 
subjects.  b     #      refers  to  the  number  of  subjects  in  which 
at  least  one  behavior  was  observed. 
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Table  19 

Summary  of  Reliability  for  Parent  Categories  in  the  Parent 
Directed  Interaction — Clinic-referred  Group 


CATEGORY  Suma  £b   Mean    Weighted 

%  Agree   %  Agree 


Direct  Command 

502 

30 

79% 

83% 
(79%-86%) 

.67 

Indirect  Command 

169 

29 

54% 

57% 
(50%-63%) 

.56 

Information  Question 

184 

29 

84% 

85% 
(79%-91%) 

.77 

Descriptive /Reflective 
Question 

335 

30 

75% 

79% 
(74%-84%) 

.75 

Behavioral  Description 

8 

7 

43% 

40% 
(3%-77%) 

.43 

Information  Description 

707 

30 

77% 

77% 
(74%-80%) 

.66 

Reflective  Statement 

1  1 

10 

51% 

50% 

(20%-80%) 

.47 

Acknowledgment 

185 

29 

50% 

51% 
(42%-59%) 

.56 

Labeled  Praise 

4 

4 

75% 

75% 
(-5%-155%) 

.67 

Unlabeled  Praise 

33 

20 

88% 

87% 
(75%-99%) 

.71 

Contingent  Praise 

0 

0 

— 

— 

— 

Criticism 

200 

30 

70% 

64% 
(55%-74%) 

.63 

Smart  Talk 

31 

10 

22% 

52% 

(25%-80%) 

.56 
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Table  19  continued 


CATEGORY 

Suma 

#b 

Mean 
%  Agree 

Weighted 
%  Agree 

k 

Destructive 

0 

0 

— 

— 

— 

Physical  Positive 

18 

10 

32% 

38% 
(15%-61%) 

.85 

Physical  Negative 

34 

1  4 

36% 

30% 
(10%— 51%) 

.71 

Playtalk 

36 

12 

38% 

49% 
(29%-68%) 

.63 

Laugh 

38 

17 

68% 

67% 
(54%-79%) 

.83 

Whine 

9 

6 

23% 

25% 
(-5%-55%) 

1  .0 

Yell 

0 

1 

— 

— 

— 

Answer 

53 

24 

68% 

69% 

(58%-81%) 

.89 

No  Answer 

10 

9 

44% 

41% 
(9%-73%) 

.44 

No  Opportunity  for  Answer 

14 

12 

46% 

50% 
(25%-75%) 

.89 

Compliance 

16 

12 

57% 

53% 
(25%-81%) 

.88 

Noncompliance 

26 

14 

47% 

48% 
(29%-68%) 

.84 

No  Opportunity  for 
Compliance 

64 

21 

55% 

58% 
(46%-71%) 

.66 

Warning 

0 

0 

— 

— 

— 

Note:   Analyses  based  on  n  =  30 

Dashes  i 

ndicate 

calculations  that  could  not  be  computed. 
a  Sum  refers  to  the  total  number  of  behaviors  coded  across 
subjects.  b     #      refers  to  the  number  of  subjects  in  which 
at  least  one  behavior  was  observed. 
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Table  20 


Summary  of  Reliability  for  Parent  Categories  in  Clean-Up- 
Clinic-referred  Group 


CATEGORY 


Mean    Weighted 
Agree   %  Agree 


Direct  Command 

754 

30 

80% 

88% 
(84%-91%) 

.67 

Indirect  Command 

275 

30 

59% 

70% 
(64%-76%) 

.65 

Information  Question 

95 

26 

79% 

84% 
(75%-94%) 

.81 

Descriptive/Reflective 
Question 

191 

30 

76% 

78% 
(72%-84%) 

.70 

Behavioral  Description 

3 

7 

14% 

14% 
(-21%-49%) 

.25 

Information  Description 

571 

30 

69% 

69% 
(63%-74%) 

.57 

Reflective  Statement 

6 

7 

64% 

63% 

(21%-104%) 

.14 

Acknowledgment 

146 

29 

55% 

56% 
(47%-64%) 

.51 

Labeled  Praise 

4 

5 

60% 

60% 
(-8%-128%) 

.60 

Unlabeled  Praise 

48 

19 

62% 

67% 
(50%-83%) 

.62 

Contingent  Praise 

0 

0 

— 

— 



Criticism 

203 

28 

58% 

63% 
(54%-71%) 

.61 

Smart  Talk 

36 

14 

26% 

43% 
(26%-60%) 

.51 

= 
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Table  20  continued 


CATEGORY  Suma  #b   Mean    Weighted     k 

%  Agree   %  Agree 


Destructive 
Physical  Positive 
Physical  Negative 

Playtalk 

Yell 

Whine 

Laugh 

Answer 

No  Answer 


Compliance 
Noncompliance 


No  Opportunity  for 
Compliance 

Warning  0     0 


0 

0 

— 

— 

— 

3 

9 

0% 

— 

-.01 

32 

12 

39% 

61% 
(37%-84%) 

1  .0 

8 

0 
4 

3 

0 
6 

8* 

13% 
(-26%-51%) 

1  .0 

0% 

— 

.00 

11 

8 

47% 

50% 
(10%-90%) 

.70 

69 

23 

71% 

69% 
(59%-79%) 

.87 

23 

15 

28% 

37% 
(18%-56%) 

.51 

14 

12 

42% 

45% 
(21%-69%) 

.59 

6 

5 

73% 

71% 
(26%-117%) 

.66 

34 

17 

43% 

43% 
(24%-61%) 

.80 

34 

20 

27% 

34% 
(23%-45%) 

.51 

Note:   All  analyses  based  on  n  =  30.    Dashes  indicate 
calculations  that  could  not  be  computed. 
a  Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.   b  #   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  21 

Summary  of  Reliability  for  Parent  Categories  in  the  Child 
Directed  Interaction — Comparison  group 


CATEGORY  Sum3  #b   Mean    Weighted     k 


%  Agree   %  Agree 


Direct  Command 

91 

28 

74% 

79% 
(70%-88%) 

.74 

Indirect  Command 

37 

21 

40% 

48% 
(36%-61%) 

.56 

Information  Question 

139 

30 

85% 

87% 
(81%-93%) 

.79 

Descriptive /Reflective 
Question 

257 

30 

79% 

82% 
(77%-87%) 

.76 

Behavioral  Description 

6 

7 

29% 

36% 

(11%-61%) 

.41 

Information  Description 

399 

30 

75% 

75% 
(72%-79%) 

.64 

Reflective  Statement 

33 

20 

50% 

47% 
(32%-62%) 

.50 

Acknowledgment 

244 

30 

63% 

63% 
(57%-69%) 

.66 

Labeled  Praise 

3 

4 

50% 

50% 
(-42%-142%) 

.50 

Unlabeled  Praise 

38 

18 

72% 

69% 

(54%-84%) 

.71 

Contingent  Praise 

0 

0 

— 

— 

— 

Criticism 

18 

9 

39% 

56% 
(31 %-81%) 

.55 

Smart  Talk 

0 

1 

— 

— 

— 
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Table  21  continued 


CATEGORY  Sum3  #h        Mean    Weighted     k 

%  Agree   %  Agree 


Destructive  0     1     

Physical  Negative  0     2     50%       50%        .50 

(-585%-685%) 

Physical  Positive         16    8     48%      62%       .90 

(24%-101%) 

Playtalk  275   18    57%       77%        .80 

(67%-87%) 

Whine  0     0     

yell  0     0— 

Lau9h  92    27    62%       67%        .84 

(56%-78%) 

Answer  50    21    70%       78%        .88 

(65%-92%) 

No  Answer  10     9    37%       31%        .66 

C-2%-64%) 

No  Opportunity  for  Answer  12    15    48%      47%       .60 

(23%-72%) 

Compliance  37    22    36%       51%        .87 

(36%-67%) 

Noncompliance  2      5    7%       14%       .19 

(-9%-37%) 

No  Opportunity  for         63    24    60%       56%        73 
Compliance  (46%-67%) 

Warning  0     0     


Note:   All  Analyses  based  on  n  =  30.   Dashes  indicate 
calculations  that  could  not  be  computed 
^nh^V^6"  ^°  fc^e  number  of  behaviors  coded  across 
?«2f     k  v,  #.refers  to  the  n«">ber  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  22 

Summary  of  Reliability  for  Parent  Categories  in  the  Parent-. 
Directed  Interaction — Comparison  group 


CATEGORY  Suma  #b        Me£m    Weighted     ^ 

%  Agree   %  Agree 


Direct  Command 

217 

27 

78% 

80% 
(74%-85%) 

.63 

Indirect  Command 

165 

29 

65% 

70% 
(64%-76%) 

.68 

Information  Question 

117 

29 

84% 

86% 
(80%-92%) 

.82 

Descriptive/Reflective 
Question 

287 

30 

83% 

83% 
(78%-88%) 

.74 

Behavioral  Description 

7 

9 

80% 

75% 
(51 %-1 00%) 

.64 

Information  Description 

693 

30 

78% 

77% 
(74%-81%) 

.64 

Reflective  Statement 

34 

19 

57% 

58% 
(43%-72%) 

.47 

Acknowledgment 

219 

29 

53% 

51% 
(45%-57%) 

.53 

Labeled  Praise 

9 

7 

86% 

92% 
(66%-119%) 

.80 

Unlabeled  Praise 

70 

26 

90% 

81% 
(72%-89%) 

.71 

Contingent  Praise 

0 

0 

— 

— 



Criticism 

47 

23 

61% 

65% 
(54%-76%) 

.62 

Smart  Talk 

4 

3 

83% 

75% 
(-1%— 151%) 

1  .0 

- 
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Table  22  continued 


CATEGORY  Suma  #b   Mean    Weighted     k 


Agree   %  Agree 


0 

1 

00% 

— 

.00 

4 

5 

70% 

67% 
(15%-118%) 

.66 

Destructive 
Physical  Positive 

Physical  Negative         3      5    00% 

Playtalk  154   15    51%      75%       .80 

(62%-88%) 

Yell  0      1    00% 

Whine  1      3    50%      50%       .50 

(-58%-158%) 

Laugh  70    24    76%      74%       .83 

(64%-85%) 

Answer  44    23    66%       71%        .87 

(59%-83%) 

No  Answer  5      8    25%       22%        .49 

(-15%-59%) 

No  Opportunity  for  Answer  8     10    32%       33%        .61 

(5%-62%) 

Compliance  12    16    42%       37%        .51 

(18%-56%) 

Noncompliance  12    15    24%      25%       .28 

(5%-45%) 

No  Opportunity  for        50    23    44%      44%       .66 
Compliance  (34%-55%) 

Warning  0     0     —       —       — 


Note:   All  analyses  based  on  n  =  30.   Dashes  indicate 
calculations  that  could  not  be  computed. 

Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.  °     §   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  23 

Summary  of  Reliability 

for  Parent  < 

-ateaories  in  the  CI 

ean- 

Up — Comparison  aroup 

CATEGORY 

Suma 

//b 

Mean 
%  Agree 

Weighted 
%  Agree 

k 

Direct  Command 

258 

30 

72% 

75% 
(67%-82%) 

.68 

Indirect  Command 

230 

29 

63% 

64% 
(59%-68%) 

.60 

Information  Question 

68 

27 

74% 

80% 
(70%-90%) 

.68 

Descriptive/ Reflective 
Question 

272 

3  0 

79% 

80% 
(76%-85%) 

.73 

Behavioral  Description 

4 

7 

29% 

18% 
(-20%-57%) 

.40 

Information  Description 

546 

30 

74% 

74% 
(70%-78%) 

.61 

Reflective  Statement 

22 

19 

31% 

40% 
(22%-58%) 

.46 

Acknowledgment 

211 

30 

59% 

61% 
(53%-69%) 

.56 

Labeled  Praise 

8 

10 

57% 

64% 
(32%-96%) 

.67 

Unlabeled  Praise 

101 

26 

73% 

80% 
(74%-88%) 

.68 

Contingent  Praise 

0 

0 

— 

— 

— 

Criticism 

62 

27 

56% 

62% 
(51%-74%) 

.59 

Smart  Talk 

3 

3 

0% 

— 

— 
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Table  23  continued 


CATEGORY  Suma  #b   Mean    Weighted     k 

%  Agree   %  Agree 


Destructive 

0 

0 

— 

— 

— 

Physical  Positive 

11 

9 

57% 

47% 
(25%-70%) 

.74 

Physical  Negative 

4 

5 

37% 

33% 
(-9%-76%) 

1  .0 

Playtalk 

23 

14 

37% 

43% 
(22%-65%) 

.52 

Yell 

0 

0 

— 

— 

— 

Whine 

2 

3 

33% 

33% 
(-1 1 0%-1 77%) 

1  .0 

Laugh 

41 

19 

64% 

61% 
(50%-73%) 

.75 

Answer 

70 

27 

75% 

77% 
(67%-87%) 

.90 

No  Answer 

11 

13 

29% 

26% 
(4%-49%) 

.53 

No  Opportunity  for  Answer 

11 

10 

44% 

50% 
(20%-80%) 

.56 

Compliance 

9 

10 

65% 

64% 
(31%-97%) 

.63 

Noncompliance 

27 

19 

40% 

37% 
(22%-53%) 

.73 

No  Opportunity  for 
Compliance 

60 

27 

42% 

49% 
(39%-60%) 

.69 

Warning 

0 

0 

— 

— 

— 

Note:   Analyses  are  based 

on  n 

=  30. 

Dashes  indicate 

calculations  that  could  not  be  computed. 
a  Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.   b  #   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  24 

Summary  of  Reliability  for  Child  Categories  in  the  Child 
Directed  Interaction — Clinic-referred  group 


CATEGORY  Suma  #b   Mean    Weighted     k 

%  Agree   %  Agree 


Direct  Command 

108 

26 

69% 

76% 
(67%-84%) 

.76 

Indirect  Command 

43 

20 

56% 

56% 
(39%-74%) 

.74 

Information  Question 

97 

25 

76% 

78% 
(69%-87%) 

.85 

Descriptive /Reflective 
Question 

82 

25 

70% 

69% 
(57%-81%) 

.66 

Behavioral  Description 

3 

3 

100% 

100% 
(100%-100%) 

1  .0 

Information  Description 

706 

30 

76% 

76% 
(73%-80%) 

.65 

Reflective  Statement 

19 

8 

64% 

60% 
(34%-86%) 

.59 

Acknowledgment 

261 

29 

62% 

62% 

(55%-70%) 

.79 

Labeled  Praise 

0 

0 

— 

— 

— 

Unlabeled  Praise 

2 

4 

50% 

67% 

(-77%-210%) 

.40 

Criticism 

26 

14 

43% 

44% 
(23%-66%) 

.51 

Smart  Talk 

15 

8 

67% 

75% 
(41%-109%) 

.63 
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Table  24  continued 


CATEGORY 

Sum3 

#b 

Mean 
%  Agree 

Weighted 
%  Agree 

k 

Destructive 

13 

5 

46% 

46% 
(25%-67%) 

.56 

Physical  Positive 

6 

4 

28% 

13% 
(-22%-47%) 

1  .0 

Physical  Negative 

4 

4 

13% 

17% 
(-27%-60%) 

.50 

Playtalk 

245 

23 

55% 

65% 
(56%-74%) 

.72 

Yell 

7 

6 

69% 

67% 
(32%-102%) 

.62 

Whine 

17 

9 

30% 

43% 
(17%-69%) 

.81 

Laugh 

47 

15 

63% 

65% 
(49%-82%) 

.90 

Answer 

127 

29 

76% 

75% 
(67%-84%) 

.83 

No  Answer 

40 

22 

31% 

44% 
(27%-60%) 

.60 

No  Opportunity  for  Answer 

45 

23 

66% 

65% 
(51%-80%) 

.76 

Compliance 

43 

17 

43% 

45% 
(29%-60%) 

.57 

Noncompliance 

15 

13 

29% 

38% 

(11%-65%) 

.53 

No  Opportunity  for 
Compliance 

100 

25 

61% 

62% 
(53%-71%) 

.71 

Note:   All  analyses  based 

on  n 

=  30 

Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.   D  §   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  25 

Summary  of  Reliability  for  Child  Categories  in  the  Parent 
Directed  Interaction — Clinic-referred  group 


CATEGORY  Suma  #b        Mean    Weighted     k 

%  Agree   %  Agree 


Direct  Command 

79 

22 

67% 

66% 
(55%-76%) 

.68 

Indirect  Command 

26 

14 

31% 

45% 
(19%-70%) 

.73 

Information  Question 

76 

25 

77% 

75% 
(63%-87%) 

.84 

Descriptive/Reflective 
Question 

8  6 

27 

61% 

62% 
(53%-72%) 

.72 

Behavioral  Description 

2 

5 

30% 

33% 
(-18%-85%) 

.33 

Information  Description 

545 

30 

75% 

76% 
(70%-81%) 

.67 

Reflective  Statement 

14 

10 

38% 

50% 
(21%-79%) 

.61 

Acknowledgment 

229 

28 

65% 

67% 
(60%-74%) 

.74 

Labeled  Praise 

0 

0 

— 

— 

— 

Unlabeled  Praise 

6 

5 

40% 

50% 
<-19%— 1 19%) 

1  .0 

Criticism 

36 

21 

54% 

47% 
(33%-62%) 

.64 

Smart  Talk 

108 

19 

58% 

56% 
(44%-68%) 

.76 
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Table  25  continued 


CATEGORY  Suma  ffb        Mean    Weighted 

%  Agree   %  Agree 


Destructive  30    12    46%      43%       .47 

(24%-62%) 

Physical  Positive  4     4     00% 

Physical  Negative         10    8     19%       17%       .39 

(-1 1 %-45%) 

Playtalk  104   18    36%       52%        .63 

(39%-65%) 

Yel1  70    14    48%       65%        .58 

(52%-79%) 

whine  59    20    35%       42%        .54 

(29%-56%) 

Laugh  29    14    43%      53%       .53 

(30%-75%) 


Answer  86    26    73% 


72% 
(62%-82%) 


No  Answer  30    21    32%      30%       .40 

(15%-45%) 

No  Opportunity  for  Answer  67    23    57%       60%        .79 

(49%-71%) 

Compliance  178   28    67%       65%        .80 

(57%-73%) 

Noncompliance  131   25    46%      44%       .52 

(35%-53%) 

No  Opportunity  for         357   30    64%       65%        55 
Compliance  (60%-69%) 


Note:   All  analyses  based  on  n  =  30 

Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.     #   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  26 

Summary  of  Reliability  for  Child  Categories  in  the  Clean-Up- 
-Clinic-ref erred  Group 


CATEGORY  Sum3  §b        Mean    Weighted     k 


%  Agree   %  Agree 


Direct  Command  44    21    43%       53%        .57 

(39%-66%) 

Indirect  Command  31    19    27%      45%       .51 

(26%-63%) 

Information  Question       107   26    76%      77%       .86 

(68%-86%) 

Descriptive/Reflective     74    26    57%      67%       .71 
Question  (55%-79%) 


Information  Description 

417 

29 

75% 

77% 
(72%-81%) 

.70 

Reflective  Statement 

1 

3 

33% 

33% 
(-1 1 0%-1 77%) 

.33 

Acknowledgment 

149 

28 

59% 

60% 
(49%-71%) 

.83 

Labeled  Praise 

I) 

0 

— 

— 

— 

Unlabeled  Praise 

1 

1 

100% 

— 

1  .0 

Criticism 

40 

16 

44% 

36% 
(18%-55%) 

.44 

Smart  Talk 

207 

25 

53% 

58% 
(50%-67%) 

.69 
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Table  26  continued 


CATEGORY  Suma  #b  Mean    Weighted     k 

%  Agree   %  Agree 

Destructive  53  20  36% 

Physical  Positive  0  1  00% 

Physical  Negative  1  3  00% 

Playtalk  35  13  68% 

Yell  93  12  54% 

Whine  186  25  39% 

Laugh  14  7  36% 

Answer  49  21  71% 

No  Answer  20  14  50% 

No  Opportunity  for  Answer  26  15  44% 

Compliance  186  27  66% 

Noncompliance  276  30  51% 

No  Opportunity  for  565  30  59%       69%        45 
Compliance  (63%-75%) 


37% 
(24%-50%) 

.46 

— 

.00 

— 

.00 

56% 

(41%-71%) 

.72 

43% 
(29%-58%) 

.51 

53% 
(42%-63%) 

.47 

63% 

(17%-108%) 

.91 

77% 
(63%-91%) 

.94 

59% 
(36%-82%) 

.68 

62% 

(42%-82%) 

.65 

70% 
(62%-77%) 

.68 

55% 
(49%-62%) 

.53 

Mote:   All  analyses  based  on  n  =  30. 

Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.     #   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  27 

Summary  of  Reliability  for  Child  Categories  in  the  Child 
Directed  Interaction — Comparison  group 


CATEGORY  Suma  #b   Mean    Weighted 

%  Agree   %  Agree 


Direct  Command  72    26    62%       68%        .71 

(57%-80%) 

Indirect  Command 
Information  Question 


Descriptive/Reflective 
Question 

Behavioral  Description 


Information  Description    530   30    77%      80%       .71 

(75%-85%) 

Reflective  Statement       8     7     29%      45%       .55 

(-4%-95%) 

Acknowledgment  166   30    62%       62%        .71 

(55%-68%) 

Labeled  Praise  0     0 

Unlabeled  Praise  5     3     42%       57%        .67 

(-21 %-1 35%) 


30 

21 

49% 

51% 
(34%-68%) 

.59 

72 

23 

90% 

90% 
(83%-98%) 

.92 

71 

28 

79% 

77% 
(68%-85%) 

.81 

2 

3 

33% 

17% 
(-97%-130%) 

— 

Criticism  22    14    52%       46% 

(24%-69% 


Smart  Talk 


.57 
00%  .00 
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Table  27  continued 


CATEGORY  Sum3  #b   Mean    Weighted 

%  Agree   %  Agree 


k 


Destructive 

6 

5 

50% 

— 

-.01 

Physical  Negative 

2 

1 

00% 

— 

— 

Physical  Positive 

8 

7 

36% 

42% 
(14%-69%) 

1  .0 

Playtalk 

172 

24 

46% 

64% 
(57%-71%) 

.74 

Yell 

3 

4 

25% 

37% 
(-10%-85%) 

1  .0 

Whine 

9 

5 

15% 

30% 
(-21%-81%) 

.75 

Laugh 

85 

15 

67% 

78% 
(65%-91%) 

.86 

Answer 

75 

26 

70% 

72% 
(61%-83%) 

.77 

No  Answer 

24 

21 

44% 

39% 
(19%-59%) 

.54 

No  Opportunity  for 
Answer 

40 

23 

67% 

63% 
(49%-77%) 

.77 

Compliance 

33 

19 

60% 

63% 
(47%-78%) 

.67 

Noncompl i ance 

12 

10 

15% 

13% 
(-9%-34%) 

.66 

No  Opportunity  for 
Compliance 

83 

29 

61% 

65% 
(56%-74%) 

.83 

Note:   All  analyses  bas 

ed  on  n 

=  30 

Sum  refers  to  the  number  of  behaviors  coded  a 
subjects.   "  #   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed 
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Table  28 

Summary  of  Reliability  for  Child  Categories  in  the  Parent 

Directed  Interaction- -Comparison  qr oup 


CATEGORY  Suma  §b        Mean    Weighted 


Agree   %  Agree 


Direct  Command 

49 

20 

65% 

68% 
(59%-76%) 

.75 

Indirect  Command 

25 

22 

47% 

37% 
(19%-54%) 

.76 

Information  Question 

58 

24 

73% 

77% 
(66%-87%) 

.84 

Descriptive/ Reflective 

67 

25 

59% 

64% 

.76 

Question 

(53%-75%) 

Behavioral  Description 

3 

4 

25% 

14% 
(-50%-79%) 

.20 

Information  Description 

449 

30 

76% 

77% 
(72%-81%) 

.78 

Reflective  Statement 

10 

10 

32% 

26% 

(-1%-54%) 

.27 

Acknowledgment 

174 

30 

60% 

62% 
(56%-69%) 

.67 

Labeled  Praise 

0 

0 

— 

— 

.67 

Unlabeled  Praise 

3 

5 

70% 

67% 
(15%-118%) 

.67 

Criticism 

55 

23 

52% 

54% 
(39%-68%) 

.67 

Smart  Talk 

8 

10 

32% 

29% 
(1%-58%) 

.41 

Table  28  continued 
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CATEGORY 


Sum3  #b   Mean    Weighted     k 
%  Agree   %  Agree 


Destructive 

4 

4 

31% 

25% 
{-31 %-81 %) 

.50 

Physical  Positive 

2 

4 

— 

— 

.00 

Physical  Negative 

8 

7 

36% 

31  % 
(-11%-73%) 

.50 

Playtalk 

92 

18 

54% 

59% 
(50%-69%) 

.72 

Yell 

5 

5 

30% 

33% 

(-13%-80%) 

.60 

Whine 

12 

12 

32% 

40% 
(15%-65%) 

.85 

Laugh 

4  0 

15 

57% 

63% 
(51%-75%) 

.65 

Answer 

70 

26 

72% 

78% 
(66%-90%) 

.82 

No  Answer 

19 

14 

29% 

28% 
(9%-46%) 

.45 

No  Opportunity  for  Answer 

29 

22 

59% 

54% 
(38%-70%) 

.60 

Compliance 

126 

28 

68% 

68% 
(61%-74%) 

.66 

Noncompliance 

33 

24 

25% 

25% 
(13%-38%) 

.35 

No  Opportunity  for 
Compliance 

222 

29 

63% 

69% 
(63%-75%) 

.07 

Note.   Analyses  based  on  r 

i  =  30 

Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.   b  §   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 
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Table  29 


Summary  of  Reliability  for  Child  Categories  in  Clesan-nn- 
Comparison  group 


CATEGORY 


Suma  #b   Mean    Weighted     k 
%  Agree   %  Agree 


Direct  Command 

58 

25 

69% 

69% 
(56%-82%) 

.79 

Indirect  Command 

39 

26 

37% 

39% 
(26%-52%) 

.49 

Information  Question 

9  3 

29 

80% 

82% 

(73%-91%) 

.90 

Descriptive/Reflective 
Question 

69 

24 

64% 

67% 
(53%-81%) 

.68 

Behavioral  Description 

0 

1 

— 

— 

— 

Information  Description 

356 

30 

85% 

84% 
(80%-87%) 

.80 

Reflective  Statement 

5 

8 

38% 

36% 
(3%-70%) 

.50 

Acknowledgment 

141 

30 

66% 

67% 
(59%-75%) 

.75 

Labeled  Praise 

1 

1 

00% 

— 

— 

Unlabeled  Praise 

4 

2 

55% 

31% 
(-451%-513%) 

1  .0 

Criticism 

21 

15 

43% 

43% 
(27%-59%) 

.74 

Smart  Talk 

23 

18 

31% 

36% 
(18%-54%) 

.49 
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Table  29  continued 


CATEGORY  Suma  #h        Mean    Weighted     k 

%  Agree   %  Agree 


Destructive 

25 

13 

34% 

42% 
(28%-57%) 

.51 

Physical  Positive 

0 

1 

00% 

— 

— 

Physical  Negative 

0 

1 

00% 

— 

.00 

Playtalk 

36 

15 

46% 

41% 
(24%-59%) 

.68 

Yell 

2 

3 

33% 

50% 
(-102%-202%) 

1  .0 

Whine 

58 

18 

58% 

58% 
(45%-71%) 

.76 

Laugh 

12 

10 

36% 

37% 
(13%-62%) 

.63 

Answer 

34 

23 

65% 

64% 
(50%-78%) 

.75 

No  Answer 

8 

11 

27% 

24% 
(-6%-53%) 

.32 

No  Opportunity  for  Answer 

25 

20 

44% 

50% 
(33%-67%) 

.62 

Compliance 

134 

29 

66% 

58% 
(47%-69%) 

.72 

Noncorapl i  ance 

79 

26 

49% 

52% 
(40%~64%) 

.62 

No  Opportunity  for 
Compliance 

272 

30 

63% 

66% 
(59%-74%) 

.68 

Note:   All  analyses  based 

on  n 

=  30. 

Sum  refers  to  the  number  of  behaviors  coded  across 
subjects.     #   refers  to  the  number  of  subjects  in  which  at 
least  one  behavior  was  observed. 


Table  30 

Intraclass  Correlations  for  Categories  Combined  Across 
Situation  for  Each  Group  and  the  Total  Sample 
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CATEGORY 


Clinic   Comparison 
(n=30)     (n=30) 


Total 
(n=60) 


PARENT  BEHAVIOR 

Direct  Command 

.99 

.98 

.99 

Indirect  Command 

.92 

.92 

.92 

Information  Question 

.93 

.93 

.93 

Descriptive/Reflective 
Question 

.93 

.88 

.90 

Behavioral  Description 

.58 

.78 

.69 

Information  Description 

.95 

.79 

.86 

Reflective  Statement 

.76 

.75 

.75 

Acknowledgment 

.79 

.91 

.86 

Labeled  Praise 

.87 

.85 

.87 

Unlabeled  Praise 

.92 

.86 

.88 

Criticism 

.94 

.93 

.94 

Smart  Talk 

.78 

.83 

.81 

Destructive 

-.02 

— 

-.008 

Physical  Positive 

.54 

.40 

.49 

Physical  Negative 

.81 

.82 

.82 

Playtalk 

.98 

.64 

.85 

Yell 

.00 

.00 

-.008 

Whine 

.31 

.70 

.54 

Laugh 

.94 

.86 

.90 

Answer 

.96 

.87 

.93 
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Table  30   cont'd. 


CATEGORY 

Clinic 
(n=30) 

Comparison 
(n=30) 

Total 
(n=60) 

PARENT  BEHAVIOR 

No  Answer 

.69 

.64          .66 

No  Opportunity  for  Answer. 82 

.70 

.78 

Compliance 

.71 

.90 

.79 

Noncompliance 

.74 

.70 

.99 

No  Opportunity  for 
Compliance 

.82 

.83 

.82 

CHILD  BEHAVIOR 

Direct  Command 

.90 

.89 

.89 

Indirect  Command 

.72 

.73 

.74 

Information  Question 

.97 

.94 

.96 

Descriptive/Reflective 
Question 

.93 

.86 

.89 

Behavioral  Description 

.60 

.65 

.63 

Information  Description 

.96 

.89 

.93 

Reflective  Statement 

.68 

.64 

.66 

Acknowledgment 

.84 

.77 

.79 

Labeled  Praise 

.00 

-.36 

-.34 

Unlabeled  Praise 

.62 

.86 

.81 

Criticism 

.52 

.71 

.60 

Smart  Talk 

.84 

.94 

.91 

Destructive 

.76 

.78 

.79 

Physical  Positive 

.18 

.45 

.37 

Physical  Negative 

-.00 

.50 

.29 
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Table  30  cont'd. 


CATEGORY  Clinic   Comparison     Total 

(n=30)     (n=30)       (n=60) 

CHILD  BEHAVIOR 

Playtalk 

Yell 

Whine 

Laugh 

Answer 

No  Answer 

No  Opportunity  for  Answer. 88 

Compliance 

Noncompliance 


No  Opportunity  for 
Compliance 


.97 

.93 

.95 

.87 

.97 

.93 

.86 

.85 

.85 

.95 

.97 

.96 

.91 

.73 

.82 

.65 

.64 

.64 

.88 

.97 

.78 

.91 

.92 

.92 

.83 

.86 

.85 

.96 

.95 

.95 
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Table  35 

Summary  of  Univariate  Analysis  of  Covariance  for  Transformed 
Summary  Variables  Comparing  the  Clinic-referred  and 
Comparison  Group 


Mean 
Variable  Clinic   Comparison      E(1,57) 


Parent  Categories 
Prosocial  Behavior 
Direct  Command  Ratio 
Total  Commands 
Inappropriate  Behavior 
Negative  Talk 
Negative  Behavior 
Child  Categories 
Prosocial  Behavior 
Compliance  ratio 

Inappropriate  Behavior 

Negative  Talk 

Negative  Vocalization 

Negative  Behavior 


92.53 

121  .37 

8.63** 

.72 

.57 

12.57** 

62.58 

39.67 

10.86** 

20.37 

5.40 

41 .58*** 

18.35 

8.30 

17.03*** 

2.35 

.42 

18.49*** 

89.98 

88.5 

.56 

.53 

.75 

16.39*** 

31  .28 

10.02 

22.68*** 

14.45 

5.10 

14.74*** 

12.77 

3.17 

24.14*** 

4.07 

1  .75 

6.95*** 

Note.   Means  based  on  n  =  30  for  each  group.   Values  based 
on  the  mean  frequency  of  occurrence  summed  across  the  three 
DPICS  II  situations. 
*  E  <  -05.   **  £  <  .01.   ***  e  <  .001. 
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Table  36 

Classification  Function  Coefficients  for  Discriminant 

Analysis  on  Untransf ormod  Variables 


Variable 


Group 


Clinic-Referred 


Comparison 


Child  Inappropriate 
Parent  Inappropriate 
Total  Command 
Parent  Prosocial 
Child  Prosocial 


.200 
.022 
.001 
.145 
.179 


Child  Compliance  29.23 

Parent  Direct  Command  Ratio  51.03 


Constant 


-44.78 


.180 

-.076 

.002 

.172 

.175 

33.67 

46.32 

-45.47 


Note.   Group  membership  for  an  individual  dyad  is  calculated 
by  multiplying  the  value  for  each  variable  by  their 
respective  coefficients  and  then  summing  the  resulting 
products  with  the  constant.   The  values  for  each  variable 
must  be  entered  into  both  equations.   The  largest  resulting 
value  indicates  which  group  the  individual  dyad  belongs. 
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Table  37 
Summary  of  Step-wise  Discriminant  Analysis 

Variable  Wilks'  Lambda   F  df 

Step  One 

Parent  Inappropriate  .66  55.71***  58 
Step  Two 

Child  Compliance  Ratio  .57  21.57***  57 
Step  Three 

Parent  Prosocial  .50     18.91***       56 

Step  Four 

SES  .46      16.26***        55 

Note.   Untransformed  variables  were  used  in  the  analysis. 
"*"e  <  -001. 
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Table  38 

Classification  Function  Coefficients  for  Stepwise 
Discriminant  Analysis  on  Untransformed  Variables 


Group 


Variable             Clinic-Referred  Comparison 

Parent  Inappropriate        .257  .148 

Parent  Prosocial            .090  .119 

Child  Compliance  Ratio     18.841  24.898 

SES                         .320  .391 

Constant                  -18.594  -27.266 


Note.   Group  membership  for  an  individual  dyad  is  calculated 
by  multiplying  the  value  for  each  variable  by  their 
respective  coefficients  and  then  summing  the  resulting 
products  with  the  constant.   The  values  for  each  variable 
must  be  entered  into  both  equations.   The  largest  resulting 
value  indicates  which  group  the  individual  dyad  belongs. 
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Table  40 

Correlations  Between 

SES,  DPICS  II 

Summary  Variables  and 

ECBI  Intensity  Score 

Variable   2      3 

4      5 

6      7 

8      9 

1 .  SES   -.31*    .03 

-.26    .12 

-.30  -.36** 

-.16    .25 

2.  ECBI-I  —    -.11 

,  54***_ .  41  *** 

48***  .69*** 

.38**-. 39** 

CHILD  BEHAVIOR 

3.  Prosocial     — 

-.13   -.02 

-.08    .01 

-.14   .04 

4.  Inappropriate 

_.77*** 

.31**  .61*** 

.34**  -.15 

5.  Compliance  Ratio 

— 

-.23   .65*** 

-.21    .09 

PARENT  BEHAVIOR 

6.  Direct  Command  Rat 

io 

—  — . 51 *** 

.32*-. 43*** 

7.  Inappropriate 

— 

.52***-.  35** 

8 .  Total  Command 

-.17 

9.   Prosocial 

— 

Note.  All  analyses  based  on  N  =  60. 
*p_  <  .05.   **p_  <  .01.   ***p_  <  .001. 
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Table  42 

Summary  of  Hierarchical  Multiple  Regression  Analysis  for 
Transformed  Variables  Predicting  ECBI  Intensity  Score 

Predictor  Variable  P       R2  change   F  change 

SES 

Parent  Inappropriate 

Parent  Prosocial  Behavior 

Child  Inappropriate 

Compliance 

Direct  Command  Ratio 

Total  Command 

Child  Prosocial  Behavior 

Note,  p  coefficients  are  given  for  eguation  when  all 
variables  entered. 
**  E  <  .01 . 


-.09 

.12 

7.88** 

.44 

.27 

25.43** 

-.15 

.03 

2.49 

.13 

.01 

1  .39 

-.03 

.0003 

.02 

.13 

.009 

.89 

-.10 

.004 

.40 

.08 

.006 

.57 
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Table  44 


Correlation  Matrix  for  Transformed  Child  Variables  Used  to 
Predict  the  Child  Domain  Score  on  the  PSI 


Variable 


1  .  SES 

2.  Compliance  Ratio 

3.  Prosocial 

4.  Inappropriate  Behavior 


.12 


-.12    -.26* 
-.05   -.77*** 
.02 


E  <  .05.  ***  £  <  .001 
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Table  46 


Summary  of  Hierarch. 

ical 

Mult 

iple 

Regression  Analvs 

;is 

for 

Transformed  Variabli 

ss  Predic 

tinq 

PSI 

Child 

Domain 

Scores 

Predictor  Variable 

P 

R2 

change 

F 

change 

SES 

Child  Inappropriate  Behavior 

Child  Compliance 

Child  Prosocial  Behavior 


-.30 

.13 

8.92** 

.33 

.11 

7.28** 

-.02 

.004 

.005 

-.05 

.002 

.16 

Note .   p  coefficients  are  given  for  equation  when  all 
variables  entered. 
**  p.  <  -01  • 
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Table  47 

Correlation  Matrix  for  Parent  Variables  Used  to  Predict  the 
Parent  Domain  Score  on  the  PSI 


Variable 


1.  SES  —  -.30*  -.16  -.36***  .25 

2.  Direct  Command  Ratio  —     —  .32*  .  65***-.  43*** 

3.  Total  Commands  —  —  —  .5  2**  -.17 

4.  Inappropriate  Behavior  —  —  —  —  _.35** 

5.  Prosocial  Behavior  —  —  —      


E  <  .05.   ***  e  <  .001 
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Table  50 

Summary  of  Hierarchical  Multiple  Regression  Analysis  for 
Transformed  Variables  Predicting  PSI  Parent  Domain 


Predictor  Variable 


R  change   F  change 


SES 

Inappropriate  Behavior 
Total  Commands 
Prosocial  Behavior 
Direct  Command  Ratio 


-.12         .06  4.00* 

.46         .12  8.11** 

-.13        .008  .62 

.02  .0003  .02 

.01  .00007  .004 


Note.   P  coefficients  are  given  for  equation  when  all 

variables  entered. 

*  E  <  .05.   **  p_  <  .01  . 
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Table  52 


Correlation  Matrix  for  Transformed  Variables 

Predicting  the 

PLOC  Score 

Variable          2     3      4     5      6 

7     8 

1.  SES  -.16  -.30*  -.36**-. 26*   .12      .25   -.12 

2.  Total  Commands    .32*   .52***34**  -.21    -.17   .12 

3.  Direct  Command  .65***. 31*  -.23*  -.43***-. 04 
Ratio 

4.  Parent  .61***. 51***  -.35**-. 001 
Inappropriate 

5.  Child  _.77***   _.-|5   .02 
Inappropriate 

6.  Compliance  .09   -.05 

7.  Parent  Prosocial  .04 

8.  Child  Prosocial 

*  p_  <  .05.   **  p_  <  .01.   ***  p.  <  .001. 
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APPENDIX  B 

SUMMARY  OF  DPICS  II  CATEGORIES 

Note:   Because  the  DPICS  II  categories  are  reflexive,  the 
following  list  of  categories  applies  to  both  parent  and 
child  behavior. 

1 .  Plavtalk  —  any  verbalization  given  as  part  of  "pretend 
talk",  where  the  speaker  is  talking  as  a  toy  or  character 
other  than  him  or  herself. 

2.  Acknowledgment  —  a  brief  verbal  response  that  indicates 
attention  to  verbal  or  nonverbal  behavior  of  either  person 
in  the  dyad,  but  does  not  describe  or  evaluate  that 
behavior. 

3.  Behavioral  Description  —  a  declarative  sentence  where 
the  subject  is  the  other  member  of  the  dyad  and  the  verb 
describes  the  other  person's  verbal  or  nonverbal  observable 
behavior. 

4.  Information  Description  —  a  declarative  sentence  that 
gives  an  account  of  people,  the  play,  or  events  that  does 
not  clearly  describe  the  other  member  of  the  dyad's  current 
or  immediately  completed  behavior. 

5.  Reflective  Statements  —  a  declarative  statement  which 
immediately  repeats  the  other  person's  verbalization. 

6.  Descriptive/Reflective  Questions  —  a  descriptive  or 
reflective  comment  or  acknowledgement  expressed  in  a 
question  form. 

7.  Information  Questions  —  questions  that  require  specific 
information  from  the  other  person  other  than  a  simple 
acknowledgement . 

8.  Indirect  Commands  —  an  order,  demand,  or  direction  for 
a  behavioral  response  that  is  implied,  nonspecific,  or 
stated  in  a  question  form. 

9-   Direct  Command  —  a  clearly  stated  order,  demand,  or 
direction  in  a  declarative  form  which  is  sufficiently 
specific  as  to  indicate  the  behavior  that  is  expected  from 
the  other  person. 
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10.  Labeled  Praise  —  a  verbalization  that  expresses  a 
favorable  judgment  upon  a  specific  activity  or  product  of 
the  other  member  of  the  dyad  or  the  speaker. 

1 1 .  Unlabeled  Praise  —  a  verbalization  that  expresses  a 
nonspecific  favorable  judgement  of  the  other  person/self,  an 
attribute  of  the  other/self,  or  a  nonspecific  activity  or 
product  of  the  other/self. 

12.  Criticism  —  a  verbal  expression  of  disapproval  of  the 
other  person,  and/or  the  other's  attributes,  activities, 
products,  or  choices. 

13.  Smart  Talk  —  sassy,  sarcastic  speech,  rude,  or 
impudent  speech. 

14.  Yell  —  a  loud  screech,  scream,  shout,  or  loud  crying 
which  is  clearly  above  the  intensity  of  the  speaker's  normal 
speech  volume. 

15.  Whine  —  words  uttered  in  a  slurring,  nasal,  high- 
pitched,  falsetto  tone,  clearly  distinct  from  the  normal 
tone  of  the  speaker's  verbalizations. 

16.  Laugh  —  any  chuckling  or  laughing  that  is  not 
associated  with  any  teasing  or  taunting  behavior. 

17.  Physical  Negative  —  any  touching  of  the  other  person 
that  attempts  to  restrain  or  inflict  pain. 

18.  Physical  Positive  —  any  touching  of  the  other  person 
that  is  neutral  or  positive. 

19.  Destructive  —  any  action  which  destroys,  damages,  or 
attempts  to  damage  any  object. 

20.  Compliance  —  when  the  person  obeys,  begins  to  obey,  or 
attempts  to  obey  a  direct  or  indirect  command  given  by  the 
other  person. 

21 .  Noncompl i ance  —  when  the  person  does  not  obey  a  direct 
or  indirect  command  given  by  the  other  person  within  five 
seconds. 

22.  No  Opportunity  for  Compliance  —  when  the  person  is  not 
given  adequate  chance  to  comply  to  a  command  issued  by  the 
other  member  of  the  dyad. 

23.  Answer  —  when  the  person  answers,  starts  to  answer,  or 
tries  to  answer  an  information  question  posed  by  the  other. 
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24.  No  Answer  —  when  the  person  does  not  answer  the  other 
person's  information  question  within  five  seconds  either  by 
giving  no  response  or  by  giving  a  rude,  sassy,  or 
deliberately  false  response. 

25.  No  Opportunity  for  Answer  —  when  the  person  is  not 
given  an  adequate  chance  to  respond  to  an  information 
question  issued  by  the  other  member  of  the  dyad. 

26.  Contingent  Labeled  Praise3  —  when  the  parent  issues  a 
labeled  praise  in  response  to  the  child's  compliance  to  a 
command . 

27.  Warning3  —  when  the  parent  issues  a  statement 
following  a  command  indicating  that  the  child  will  be  placed 
in  time-out  following  further  noncompliance  to  the  command. 


These  categories  coded  for  parents  only. 
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